Bit Error Tolerance Metrics for Binarized Neural Networks. To reduce the resource demand of neural network (NN) inference systems, it has been proposed to use approximate memory, in which the supply voltage and the timing parameters are tuned trading accuracy with energy consumption and performance. Tuning these parameters aggressively leads to bit errors, which can be tolerated by NNs when bit flips are injected during training. However, bit flip training, which is the state of the art for achieving bit error tolerance, does not scale well it leads to massive overheads and cannot be applied for high bit error rates (BERs). Alternative methods to achieve bit error tolerance in NNs are needed, but the underlying principles behind the bit error tolerance of NNs have not been reported yet. With this lack of understanding, further progress in the research on NN bit error tolerance will be restrained. In this study, our objective is to investigate the internal changes in the NNs that bit flip training causes, with a focus on binarized NNs (BNNs). To this end, we quantify the properties of bit error tolerant BNNs with two metrics. First, we propose a neuron level bit error tolerance metric, which calculates the margin between the pre activation values and batch normalization thresholds. Secondly, to capture the effects of bit error tolerance on the interplay of neurons, we propose an inter neuron bit error tolerance metric, which measures the importance of each neuron and computes the variance over all importance values. Our experimental results support that these two metrics are strongly related to bit error tolerance.


Type Anywhere You Want An Introduction to Invisible Mobile Keyboard. Contemporary soft keyboards possess limitations the lack of physical feedback results in an increase of typos, and the interface of soft keyboards degrades the utility of the screen. To overcome these limitations, we propose an Invisible Mobile Keyboard (IMK), which lets users freely type on the desired area without any constraints. To facilitate a data driven IMK decoding task, we have collected the most extensive text entry dataset (approximately 2M pairs of typing positions and the corresponding characters). Additionally, we propose our baseline decoder along with a semantic typo correction mechanism based on self attention, which decodes such unconstrained inputs with high accuracy (96.0 ). Moreover, the user study reveals that the users could type faster and feel convenience and satisfaction to IMK with our decoder. Lastly, we make the source code and the dataset public to contribute to the research community.


Algebras of pseudo differential operators acting on holomorphic Sobolev spaces. We search for pseudo differential operators acting on holomorphic Sobolev spaces. The operators should mirror the standard Sobolev mapping property in the holomorphic analogues. The setting is a closed real analytic Riemannian manifold, or Lie group with a bi invariant metric, and the holomorphic Sobolev spaces are defined on a fixed Grauert tube about the core manifold. We find that every pseudo differential operator in the commutant of the Laplacian is of this kind. Moreover, so are all the operators in the commutant of certain analytic pseudo differential operators, but for more general tubes, provided that an old statement of Boutet de Monvel holds true generally. In the Lie group setting, we find even larger algebras, and characterize all their elliptic elements. These latter algebras are determined by global matrix valued symbols.


Disconnected Matchings. In 2005, Goddard, Hedetniemi, Hedetniemi and Laskar Generalized subgraph restricted matchings in graphs, Discrete Mathematics, 293 (2005) 129 138 asked the computational complexity of determining the maximum cardinality of a matching whose vertex set induces a disconnected graph. In this paper we answer this question. In fact, we consider the generalized problem of finding c disconnected matchings such matchings are ones whose vertex sets induce subgraphs with at least c connected components. We show that, for every fixed c geq 2 , this problem is NP complete even if we restrict the input to bounded diameter bipartite graphs, while can be solved in polynomial time if c 1 . For the case when c is part of the input, we show that the problem is NP complete for chordal graphs, while being solvable in polynomial time for interval graphs. Finally, we explore the parameterized complexity of the problem. We present an FPT algorithm under the treewidth parameterization, and an XP algorithm for graphs with a polynomial number of minimal separators when parameterized by c . We complement these results by showing that, unless NP subseteq coNP poly, the related Induced Matching problem does not admit a polynomial kernel when parameterized by vertex cover and size of the matching nor when parameterized by vertex deletion distance to clique and size of the matching. As for Connected Matching, we show how to obtain a maximum connected matching in linear time given an arbitrary maximum matching in the input.


Zero shot hashtag segmentation for multilingual sentiment analysis. Hashtag segmentation, also known as hashtag decomposition, is a common step in preprocessing pipelines for social media datasets. It usually precedes tasks such as sentiment analysis and hate speech detection. For sentiment analysis in medium to low resourced languages, previous research has demonstrated that a multilingual approach that resorts to machine translation can be competitive or superior to previous approaches to the task. We develop a zero shot hashtag segmentation framework and demonstrate how it can be used to improve the accuracy of multilingual sentiment analysis pipelines. Our zero shot framework establishes a new state of the art for hashtag segmentation datasets, surpassing even previous approaches that relied on feature engineering and language models trained on in domain data.


Using Computer Simulations to Investigate the Potential Performance of 'A to B' Routing Systems for People with Mobility Impairments. Navigating from 'A to B' remains a serious problem for many people with mobility impairments, due to the need to avoid accessibility barriers. Yet there is currently no effective routing tool that is regularly used by people with disabilities in order to effectively avoid accessibility barriers in the built environment. To explore what is required to produce an effective routing tool, we have conducted Monte Carlo simulations, simulating over 460 million journeys. This work illustrates the need to focus on barrier minimization, instead of barrier avoidance, due to the limitations of what can be achieved by any accessibility documentation tool. We also make a substantial contribution to the concern of meaningful performance metrics for activity recognition, illustrating how simulations can operate as useful real world performance metrics for information sources utilized by navigation systems.


An Online Question Answering System based on Sub graph Searching. Knowledge graphs (KGs) have been widely used for question answering (QA) applications, especially the entity based QA. However, searching an swers from an entire large scale knowledge graph is very time consuming and it is hard to meet the speed need of real online QA systems. In this pa per, we design a sub graph searching mechanism to solve this problem by creating sub graph index, and each answer generation step is restricted in the sub graph level. We use this mechanism into a real online QA chat system, and it can bring obvious improvement on question coverage by well answer ing entity based questions, and it can be with a very high speed, which en sures the user experience of online QA.


CLASTER Clustering with Reinforcement Learning for Zero Shot Action Recognition. Zero shot action recognition is the task of recognizingaction classes without visual examples, only with a seman tic embedding which relates unseen to seen classes. Theproblem can be seen as learning a function which general izes well to instances of unseen classes without losing dis crimination between classes. Neural networks can modelthe complex boundaries between visual classes, which ex plains their success as supervised models. However, inzero shot learning, these highly specialized class bound aries may not transfer well from seen to unseen classes.In this paper we propose a centroid based representation,which clusters visual and semantic representation, consid ers all training samples at once, and in this way generaliz ing well to instances from unseen classes. We optimize theclustering using Reinforcement Learning which we show iscritical for our approach to work. We call the proposedmethod CLASTER and observe that it consistently outper forms the state of the art in all standard datasets, includ ing UCF101, HMDB51 and Olympic Sports both in thestandard zero shot evaluation and the generalized zero shotlearning. Further, we show that our model performs com petitively in the image domain as well, outperforming thestate of the art in many settings.


RAIDER Reinforcement aided Spear Phishing Detector. Spear Phishing is a harmful cyber attack facing business and individuals worldwide. Considerable research has been conducted recently into the use of Machine Learning (ML) techniques to detect spear phishing emails. ML based solutions may suffer from zero day attacks unseen attacks unaccounted for in the training data. As new attacks emerge, classifiers trained on older data are unable to detect these new varieties of attacks resulting in increasingly inaccurate predictions. Spear Phishing detection also faces scalability challenges due to the growth of the required features which is proportional to the number of the senders within a receiver mailbox. This differs from traditional phishing attacks which typically perform only a binary classification between phishing and benign emails. Therefore, we devise a possible solution to these problems, named RAIDER Reinforcement AIded Spear Phishing DEtectoR. A reinforcement learning based feature evaluation system that can automatically find the optimum features for detecting different types of attacks. By leveraging a reward and penalty system, RAIDER allows for autonomous features selection. RAIDER also keeps the number of features to a minimum by selecting only the significant features to represent phishing emails and detect spear phishing attacks. After extensive evaluation of RAIDER over 11,000 emails and across 3 attack scenarios, our results suggest that using reinforcement learning to automatically identify the significant features could reduce the dimensions of the required features by 55 in comparison to existing ML based systems. It also improves the accuracy of detecting spoofing attacks by 4 from 90 to 94 . In addition, RAIDER demonstrates reasonable detection accuracy even against a sophisticated attack named Known Sender in which spear phishing emails greatly resemble those of the impersonated sender.


Finite groups can be generated by a pi subgroup and a pi' subgroup. Answering a question of Dan Haran and generalizing some results of Aschbacher Guralnick and Suzuki, we prove that given a set of primes pi, any finite group can be generated by a pi subgroup and a pi' subgroup. This gives a free product description of a countably generated free profinite group.


A novel in vivo approach to assess strains of the human abdominal wall under known intraabdominal pressure. The study concerns mechanical behaviour of a living human abdominal wall. A better mechanical understanding of a human abdominal wall and recognition of its material properties is required to find mechanically compatible surgical meshes to significantly improve the treatment of ventral hernias. A non invasive methodology, based on in vivo optical measurements is proposed to determine strains of abdominal wall corresponding to a known intraabdominal pressure. The measurement is performed in the course of a standard procedure of peritoneal dialysis. A dedicated experimental stand is designed for the experiment. The photogrammetric technique is employed to recover the three dimensional surface geometry of the anterior abdominal wall at the initial and terminal instants of the dialysis. This corresponds to two deformation states, before and after filling the abdominal cavity with dialysis fluid. The study provides information on strain fields of living human abdominal wall. The inquiry is aimed at principal strains and their directions, observed at the level from 10 to 17 . The intraabdominal pressure related to the amount of introduced dialysis fluid measured within the medical procedure covers the range 11 18.5 cmH 2 O. The methodology leads to the deformation state of the abdominal wall according to the corresponding loading conditions. Therefore, the study is a step towards an identification of mechanical properties of living human abdominal wall.


New bounds on Cantor maximal operators. We prove L p bounds for the maximal operators associated to an Ahlfors regular variant of fractal percolation. Our bounds improve upon those obtained by I. L aba and M. Pramanik and in some cases are sharp up to the endpoint. A consequence of our main result is that there exist Ahlfors regular Salem Cantor sets of any dimension 1 2 such that the associated maximal operator is bounded on L 2( mathbb R ) . We follow the overall scheme of L aba Pramanik for the analytic part of the argument, while the probabilistic part is instead inspired by our earlier work on intersection properties of random measures.


Pebbles, Graphs, and a Pinch of Combinatorics Towards Tight I O Lower Bounds for Statically Analyzable Programs. Determining I O lower bounds is a crucial step in obtaining communication efficient parallel algorithms, both across the memory hierarchy and between processors. Current approaches either study specific algorithms individually, disallow programmatic motifs such as recomputation, or produce asymptotic bounds that exclude important constants. We propose a novel approach for obtaining precise I O lower bounds on a general class of programs, which we call Simple Overlap Access Programs (SOAP). SOAP analysis covers a wide variety of algorithms, from ubiquitous computational kernels to full scientific computing applications. Using the red blue pebble game and combinatorial methods, we are able to bound the I O of the SOAP induced Computational Directed Acyclic Graph (CDAG), taking into account multiple statements, input output reuse, and optimal tiling. To deal with programs that are outside of our representation (e.g., non injective access functions), we describe methods to approximate them with SOAP. To demonstrate our method, we analyze 38 different applications, including kernels from the Polybench benchmark suite, deep learning operators, and for the first time applications in unstructured physics simulations, numerical weather prediction stencil compositions, and full deep neural networks. We derive tight I O bounds for several linear algebra kernels, such as Cholesky decomposition, improving the existing reported bounds by a factor of two. For stencil applications, we improve the existing bounds by a factor of up to 14. We implement our method as an open source tool, which can derive lower bounds directly from provided C code.


Property Inference From Poisoning. Property inference attacks consider an adversary who has access to the trained model and tries to extract some global statistics of the training data. In this work, we study property inference in scenarios where the adversary can maliciously control part of the training data (poisoning data) with the goal of increasing the leakage. Previous work on poisoning attacks focused on trying to decrease the accuracy of models either on the whole population or on specific sub populations or instances. Here, for the first time, we study poisoning attacks where the goal of the adversary is to increase the information leakage of the model. Our findings suggest that poisoning attacks can boost the information leakage significantly and should be considered as a stronger threat model in sensitive applications where some of the data sources may be malicious. We describe our emph property inference poisoning attack that allows the adversary to learn the prevalence in the training data of any property it chooses. We theoretically prove that our attack can always succeed as long as the learning algorithm used has good generalization properties. We then verify the effectiveness of our attack by experimentally evaluating it on two datasets a Census dataset and the Enron email dataset. We were able to achieve above 90 attack accuracy with 9 10 poisoning in all of our experiments.


Robust design optimisation of continuous flow polymerase chain reaction thermal flow systems. This paper presents an efficient methodology for the robust optimisation of Continuous Flow Polymerase Chain Reaction (CFPCR) devices. It enables the effects of uncertainties in device geometry, due to manufacturing tolerances, on the competing objectives of minimising the temperature deviations within the CFPCR thermal zones, together with minimising the pressure drop across the device, to be explored. We first validate that our training data from conjugate heat transfer simulations of the CFPCR thermal flow problems is noise free and then combine a deterministic surrogate model, based on the mean of a Gaussian Process Regression (GPR) simulator, with Polynomial Chaos Expansions (PCE) to propagate the manufacturing uncertainties in the geometry design variables into the optimisation outputs. The resultant probabilistic model is used to solve a series of robust optimisation problems. The influence of the robust problem formulation and constraints on the design conservatism of the robust optima in comparison with the corresponding deterministic cases is explored briefly.


Beyond Participation A Review of Co Creation in Computing. New methods and technologies for engaging future users and other stakeholders in participatory (design) processes are being developed and proposed. Increasingly, researchers refer to co creation in order to capture such approaches. However, how co creation is being framed and understood across domains differs substantially. To better understand co creation in computing, we conducted a literature review of all papers in the ACM Digital Library with co creation or co create in their abstracts. After an initial screening, we retained 62 for further analysis. We introduce a framework to analyze different notions of co creation, distinguishing between co creation target audiences, the roles of co creators, the role of technology (as means or objective) and its results. We discuss the adoption of co creation in domains such as learning, business, arts culture, health, and the public sector. This paper contributes to the understanding of different approaches and conceptualizations of co creation in computing and puts forward an agenda for future research.


Learning Online Visual Invariances for Novel Objects via Supervised and Self Supervised Training. Humans can identify objects following various spatial transformations such as scale and viewpoint. This extends to novel objects, after a single presentation at a single pose, sometimes referred to as online invariance. CNNs have been proposed as a compelling model of human vision, but their ability to identify objects across transformations is typically tested on held out samples of trained categories after extensive data augmentation. This paper assesses whether standard CNNs can support human like online invariance by training models to recognize images of synthetic 3D objects that undergo several transformations rotation, scaling, translation, brightness, contrast, and viewpoint. Through the analysis of models' internal representations, we show that standard supervised CNNs trained on transformed objects can acquire strong invariances on novel classes even when trained with as few as 50 objects taken from 10 classes. This extended to a different dataset of photographs of real objects. We also show that these invariances can be acquired in a self supervised way, through solving the same different task. We suggest that this latter approach may be similar to how humans acquire invariances.


Normal matrices. Let A be a square complex matrix and z a complex number. The distance, with respect to the spectral norm, from A to the set of matrices which have z as an eigenvalue is less than or equal to the distance from z to the spectrum of A . If these two distances are equal for a sufficiently large finite set of numbers z which are not in the spectrum of A , then the matrix A is normal.


Cohomological Blow Ups of Graded Artinian Gorenstein Algebras Along Surjective Maps. We introduce the cohomological blow up of a graded Artinian Gorenstein (AG) algebra along a surjective map, which we term BUG (Blow Up Gorenstein) for short. This is intended to translate to an algebraic context the cohomology ring of a blow up of a projective manifold along a projective submanifold. We show, among other things, that a BUG is a connected sum, that it is the general fiber in a flat family of algebras, and that it preserves the strong Lefschetz property. We also show that standard graded compressed algebras are rarely BUGs, and we classify those BUGs that are complete intersections. We have included many examples throughout this manuscript.


A Different Perspective On The Stochastic Convex Feasibility Problem. We analyze a simple randomized subgradient method for approximating solutions to stochastic systems of convex functional constraints, the only input to the algorithm being the size of minibatches. By introducing a new notion of what is meant for a point to approximately solve the constraints, determining bounds on the expected number of iterations reduces to determining a hitting time for a compound Bernoulli process, elementary probability. Besides bounding the expected number of iterations quite generally, we easily establish concentration inequalities on the number of iterations, and more interesting, we establish much improved bounds when a notion akin to H " o lderian growth is satisfied, for all degrees of growth, not just the linear growth of piecewise linear convex functions or the quadratic growth of strongly convex functions. Finally, we establish the analogous results under a slight modification to the algorithm which results in the user knowing with high confidence an iterate is in hand that approximately solves the system. Perhaps surprisingly, the iteration bounds here are deterministic all of the probability gets wrapped into the confidence level (albeit at the expense of potentially large minibatches).


Relation Preserving Triplet Mining for Stabilizing the Triplet Loss in Vehicle Re identification. Object appearances often change dramatically with pose variations. This creates a challenge for embedding schemes that seek to map instances with the same object ID to locations that are as close as possible. This issue becomes significantly heightened in complex computer vision tasks such as re identification(re id). In this paper, we suggest these dramatic appearance changes are indications that an object ID is composed of multiple natural groups and it is counter productive to forcefully map instances from different groups to a common location. This leads us to introduce Relation Preserving Triplet Mining (RPTM), a feature matching guided triplet mining scheme, that ensures triplets will respect the natural sub groupings within an object ID. We use this triplet mining mechanism to establish a pose aware, well conditioned triplet cost function. This allows a single network to be trained with fixed parameters across three challenging benchmarks, while still providing state of the art re identification results.


Verifying and Optimizing Compact NUMA Aware Locks on Weak Memory Models. Developing concurrent software is challenging, specially if it has to run on modern architectures with Weak Memory Models (WMMs) such as Armv8 and RISC V. For the sake of performance, WMMs allow hardware and compilers to aggressively reorder memory accesses. To guarantee correctness, developers have to carefully place memory barriers in the code to enforce ordering among critical memory operations. While WMM architectures are growing in popularity, it is notoriously difficult to identify the necessary and sufficient barriers of complex synchronization primitives. Unfortunately, recent publications often consider barriers just implementation details and omit them. In this technical note, we report our efforts in verifying the correctness of the Compact NUMA Aware (CNA) lock algorithm on WMMs, inserting a correct and efficient set of barriers in the implementation. The CNA lock is of special interest because it is being integrated in Linux qspinlock, and this integration process has produced several reviews of the algorithm. We intend to contribute to this process by verifying the correctness of the latest patch (v15) on WMMs.


Radflow A Recurrent, Aggregated, and Decomposable Model for Networks of Time Series. We propose a new model for networks of time series that influence each other. Graph structures among time series are found in diverse domains, such as web traffic influenced by hyperlinks, product sales influenced by recommendation, or urban transport volume influenced by road networks and weather. There has been recent progress in graph modeling and in time series forecasting, respectively, but an expressive and scalable approach for a network of series does not yet exist. We introduce Radflow, a novel model that embodies three key ideas a recurrent neural network to obtain node embeddings that depend on time, the aggregation of the flow of influence from neighboring nodes with multi head attention, and the multi layer decomposition of time series. Radflow naturally takes into account dynamic networks where nodes and edges change over time, and it can be used for prediction and data imputation tasks. On real world datasets ranging from a few hundred to a few hundred thousand nodes, we observe that Radflow variants are the best performing model across a wide range of settings. The recurrent component in Radflow also outperforms N BEATS, the state of the art time series model. We show that Radflow can learn different trends and seasonal patterns, that it is robust to missing nodes and edges, and that correlated temporal patterns among network neighbors reflect influence strength. We curate WikiTraffic, the largest dynamic network of time series with 366K nodes and 22M time dependent links spanning five years. This dataset provides an open benchmark for developing models in this area, with applications that include optimizing resources for the web. More broadly, Radflow has the potential to improve forecasts in correlated time series networks such as the stock market, and impute missing measurements in geographically dispersed networks of natural phenomena.


Estimating the Generalization in Deep Neural Networks via Sparsity. Generalization is the key capability for deep neural networks (DNNs). However, it is challenging to give a reliable measure of the generalization ability of a DNN via only its nature. In this paper, we propose a novel method for estimating the generalization gap based on network sparsity. In our method, two key quantities are proposed first. They have close relationship with the generalization ability and can be calculated directly from the training results alone. Then a simple linear model involving two key quantities are constructed to give accurate estimation of the generalization gap. By training DNNs with a wide range of generalization gap on popular datasets, we show that our key quantities and linear model could be efficient tools for estimating the generalization gap of DNNs.


SparseFed Mitigating Model Poisoning Attacks in Federated Learning with Sparsification. Federated learning is inherently vulnerable to model poisoning attacks because its decentralized nature allows attackers to participate with compromised devices. In model poisoning attacks, the attacker reduces the model's performance on targeted sub tasks (e.g. classifying planes as birds) by uploading "poisoned" updates. In this report we introduce algoname , a novel defense that uses global top k update sparsification and device level gradient clipping to mitigate model poisoning attacks. We propose a theoretical framework for analyzing the robustness of defenses against poisoning attacks, and provide robustness and convergence analysis of our algorithm. To validate its empirical efficacy we conduct an open source evaluation at scale across multiple benchmark datasets for computer vision and federated learning.


Controllability of a simplified time discrete stabilized Kuramoto Sivashinsky system. In this paper, we study some controllability and observability properties for a coupled system of time discrete fourth and second order parabolic equations. This system can be regarded as a simplification of the well known stabilized Kumamoto Sivashinsky equation. Unlike the continuous case, we can prove only a relaxed observability inequality which yields a phi( triangle t) controllability result. This result tells that we cannot reach exactly zero but rather a small target whose size goes to 0 as the discretization parameter triangle t goes to 0. The proof relies on a known Carleman estimate for second order time discrete parabolic operators and a new Carleman estimate for the time discrete fourth order equation.


Complete 3D MHD simulations of the current quench phase of ITER mitigated disruptions. Complete 3D simulations of the current quench phase of ITER disruptions are key to predict asymmetric forces acting into the ITER wall. We present for the first time such simulations for ITER mitigated disruptions at realistic Lundquist numbers. For these strongly mitigated disruptions, we find that the edge safety factor remains above 2 and the maximal integral horizontal forces remain below 1 MN. The maximal integral vertical force is found to be 13 MN and arises in a time scale given by the resistive wall time as expected from theoretical considerations. In this respect, the vertical force arises after the plasma current has completely decayed, showing the importance of continuing the simulations also in the absence of plasma current. We conclude that the horizontal wall force rotation is not a concern for these strongly mitigated disruptions in ITER, since when the wall forces form, there are no remaining sources of rotation.


Very weak solution for the exterior stationary Stokes equations with Navier slip boundary condition. In some problems of fluid mechanics, it is possible to be confronted with data that are not regular, that is why we are interested here in the search for the so called very weak solutions for the stationary Stokes problem with Navier type boundary conditions in a three dimensional exterior domain. The problem describes the flow of a viscous and incompressible fluid past an obstacle where we assume that the fluid may slip on the boundary of the obstacle. Because the flow domain is unbounded, we set the problem in weighted Sobolev spaces in order to control the behavior at infinity of the solutions. Our purpose is to prove the existence and the uniqueness of a very weak solution in a Hilbertian framework.


Exploring the Impact of Virtualization on the Usability of the Deep Learning Applications. Deep Learning based (DL) applications are becoming increasingly popular and advancing at an unprecedented pace. While many research works are being undertaken to enhance Deep Neural Networks (DNN) the centerpiece of DL applications practical deployment challenges of these applications in the Cloud and Edge systems, and their impact on the usability of the applications have not been sufficiently investigated. In particular, the impact of deploying different virtualization platforms, offered by the Cloud and Edge, on the usability of DL applications (in terms of the End to End (E2E) inference time) has remained an open question. Importantly, resource elasticity (by means of scale up), CPU pinning, and processor type (CPU vs GPU) configurations have shown to be influential on the virtualization overhead. Accordingly, the goal of this research is to study the impact of these potentially decisive deployment options on the E2E performance, thus, usability of the DL applications. To that end, we measure the impact of four popular execution platforms (namely, bare metal, virtual machine (VM), container, and container in VM) on the E2E inference time of four types of DL applications, upon changing processor configuration (scale up, CPU pinning) and processor types. This study reveals a set of interesting and sometimes counter intuitive findings that can be used as best practices by Cloud solution architects to efficiently deploy DL applications in various systems. The notable finding is that the solution architects must be aware of the DL application characteristics, particularly, their pre and post processing requirements, to be able to optimally choose and configure an execution platform, determine the use of GPU, and decide the efficient scale up range.


A Bogomolov property for the canonical height of maps with superattracting periodic points. We prove that if f is a polynomial over a number field K with a finite superattracting periodic point and a non archimedean place of bad reduction, then there is an epsilon 0 such that only finitely many P in K text ab have canonical height less than epsilon with respect to f . The key ingredient is the geometry of the filled Julia set at a place of bad reduction. We also prove a conditional uniform boundedness result for the K rational preperiodic points of such polynomials, as well as a uniform lower bound on the canonical height of non preperiodic points in K . We further prove unconditional analogues of these results in the function field setting.


Units in F(C n times Q 12 ) and F(C n times D 12 ) . Let C n , Q n and D n be the cyclic group, the quaternion group and the dihedral group of order n , respectively. The structures of the unit groups of the finite group algebras FQ 12 and F(C 2 times Q 12 ) over a finite field F have been studied in J. Gildea, F. Monaghan (2011), F. Monaghan (2012), G. Tang, Y. Gao (2011) and G. Tang, Y. Wei, Y. Li (2014) whereas the structures of the unit groups of the finite group algebras FD 12 and F(C 2 times D 12 ) have been studied in J. Gildea, F. Monaghan (2011), N. Makhijani, R. K. Sharma, J. B. Srivastava (2016), F. Monaghan (2012), M. Sahai, S. F. Ansari and G. Tang, Y. Gao (2011). In this paper, we continue this study and establish the structures of the unit groups of the group algebras F(C n times Q 12 ) and F(C n times D 12 ) , over a finite field F of characteristic p containing p k elements.


An FPTAS for the Delta modular multidimensional knapsack problem. It is known that there is no EPTAS for the m dimensional knapsack problem unless W 1 FPT . It is true already for the case, when m 2 . But, an FPTAS still can exist for some other particular cases of the problem. In this note, we show that the m dimensional knapsack problem with a Delta modular constraints matrix admits an FPTAS, whose complexity bound depends on Delta linearly. More precisely, the proposed algorithm complexity is O(T LP cdot (1 varepsilon) m 3 cdot (2m) 2m 6 cdot Delta), where T LP is the linear programming complexity bound. In particular, for fixed m the arithmetical complexity bound becomes O(n cdot (1 varepsilon) m 3 cdot Delta). Our algorithm is actually a generalisation of the classical FPTAS for the 1 dimensional case. Strictly speaking, the considered problem can be solved by an exact polynomial time algorithm, when m is fixed and Delta grows as a polynomial on n . This fact can be observed combining previously known results. In this paper, we give a slightly more accurate analysis to present an exact algorithm with the complexity bound O(n cdot Delta m 1 ), quad text for m being fixed . Note that the last bound is non linear by Delta with respect to the given FPTAS.


Reinfection and low cross immunity as drivers of epidemic resurgence under high seroprevalence a model based approach with application to Amazonas, Brazil. This paper introduces a new multi strain epidemic model with reinfection and cross immunity to provide insights into the resurgence of the COVID 19 epidemic in an area with reportedly high seroprevalence due to a largely unmitigated outbreak the state of Amazonas, Brazil. Although high seroprevalence could have been expected to trigger herd immunity and prevent further waves in the state, we have observed persistent levels of infection after the first wave and eventually the emergence of a second viral strain just before an augmented second wave. Our experiments suggest that the persistent levels of infection after the first wave may be due to reinfection, whereas the higher peak at the second wave can be explained by the emergence of the second variant and a low level of cross immunity between the original and the second variant. Finally, the proposed model provides insights into the effect of reinfection and cross immunity on the long term spread of an unmitigated epidemic.


The Integer Sequence Transform a mapsto b where b n is the Number of Real Roots of the Polynomial a 0 a 1x a 2x 2 cdots a nx n . We discuss the integer sequence transform a mapsto b where b n is the number of real roots of the polynomial a 0 a 1x a 2x 2 cdots a nx n . It is shown that several sequences a give the trivial sequence b (0,1,0,1, 0,1, ldots) , i.e., b n n bmod 2 , among them the Catalan numbers, central binomial coefficients, n! and binom n k n for a fixed k . We also look at some sequences a for which b is more interesting such as a n (n 1) k for k geq 3 . Further, general procedures are given for constructing real sequences a n for which b n is either always maximal or minimal.


Construction of Differentially Private Summaries over Fully Homomorphic Encryption. Cloud computing has garnered attention as a platform of query processing systems. However, data privacy leakage is a critical problem. Chowdhury et al. proposed Crypt(epsilon), which executes differential privacy (DP) over encrypted data on two non colluding semi honest servers. Further, the DP index proposed by these authors summarizes a dataset to prevent information leakage while improving the performance. However, two problems persist 1) the original data are decrypted to apply sorting via a garbled circuit, and 2) the added noise becomes large because the sorted data are partitioned with equal width, regardless of the data distribution. To solve these problems, we propose a new method called DP summary that summarizes a dataset into differentially private data over a homomorphic encryption without decryption, thereby enhancing data security. Furthermore, our scheme adopts Li et al.'s data aware and workload aware (DAWA) algorithm for the encrypted data, thereby minimizing the noise caused by DP and reducing the errors of query responses. An experimental evaluation using torus fully homomorphic encryption (TFHE), a bit wise fully homomorphic encryption library, confirms the applicability of the proposed method, which summarized eight 16 bit data in 12.5 h. We also confirmed that there was no accuracy degradation even after adopting TFHE along with the DAWA algorithm.


An inverse problem recovering the fragmentation kernel from the short time behaviour of the fragmentation equation. The present paper provides a new representation of the solution to the fragmentation equation as a power series in the Banach space of Radon measures endowed with the total variation norm. This representation is used to justify how the fragmentation kernel, which is one of the two key parameters of the fragmentation equation, can be recovered from short time experimental measurements of the particle size distributions when the initial condition is a delta function. A new stability result for this equation is also provided using a Wasserstein type norm. We exploit this stability to prove the robustness of our reconstruction formula with respect to noise and initial data.


Model Based Testing of Networked Applications. We present a principled automatic testing framework for application layer protocols. The key innovation is a domain specific embedded language for writing nondeterministic models of the behavior of networked servers. These models are defined within the Coq interactive theorem prover, supporting a smooth transition from testing to formal verification. Given a server model, we show how to automatically derive a tester that probes the server for unexpected behaviors. We address the uncertainties caused by both the server's internal choices and the network delaying messages nondeterministically. The derived tester accepts server implementations whose possible behaviors are a subset of those allowed by the nondeterministic model. We demonstrate the effectiveness of this framework by using it to specify and test a fragment of the HTTP 1.1 protocol, showing that the automatically derived tester can capture RFC violations in buggy server implementations, including the latest versions of Apache and Nginx.


OpenGAN Open Set Recognition via Open Data Generation. Real world machine learning systems need to analyze test data that may differ from training data. In K way classification, this is crisply formulated as open set recognition, core to which is the ability to discriminate open set data outside the K closed set classes. Two conceptually elegant ideas for open set discrimination are 1) discriminatively learning an open vs closed binary discriminator by exploiting some outlier data as the open set, and 2) unsupervised learning the closed set data distribution with a GAN, using its discriminator as the open set likelihood function. However, the former generalizes poorly to diverse open test data due to overfitting to the training outliers, which are unlikely to exhaustively span the open world. The latter does not work well, presumably due to the instable training of GANs. Motivated by the above, we propose OpenGAN, which addresses the limitation of each approach by combining them with several technical insights. First, we show that a carefully selected GAN discriminator on some real outlier data already achieves the state of the art. Second, we augment the available set of real open training examples with adversarially synthesized "fake" data. Third and most importantly, we build the discriminator over the features computed by the closed world K way networks. This allows OpenGAN to be implemented via a lightweight discriminator head built on top of an existing K way network. Extensive experiments show that OpenGAN significantly outperforms prior open set methods.


Non stationary support iterations of Prikry Forcings and Restrictions of Ultrapower Embeddings to the Ground Model. We study the nonstationary support iteration of Prikry forcings below a measurable cardinal kappa, characterizing all the normal measures it carries in the generic extension. We then analyze the restriction of ultrapower embeddings, taken with such a normal measure in the generic extension, to the ground model. We prove that every such restriction is an iterated ultrapwer of the ground model, and provide a sufficient condition for its definability there. This is done without core model theoretic arguments the assumption that GCH holds in the ground model up to kappa suffices.


Formal Verification of a Map Merging Protocol in the Multi Agent Programming Contest. Communication is a critical part of enabling multi agent systems to cooperate. This means that applying formal methods to protocols governing communication within multi agent systems provides useful confidence in its reliability. In this paper, we describe the formal verification of a complex communication protocol that coordinates agents merging maps of their environment. The protocol was used by the LFC team in the 2019 edition of the Multi Agent Programming Contest (MAPC). Our specification of the protocol is written in Communicating Sequential Processes (CSP), which is a well suited approach to specifying agent communication protocols due to its focus on concurrent communicating systems. We validate the specification's behaviour using scenarios where the correct behaviour is known, and verify that eventually all the maps have merged.


Honey or Poison? Solving the Trigger Curse in Few shot Event Detection via Causal Intervention. Event detection has long been troubled by the emph trigger curse overfitting the trigger will harm the generalization ability while underfitting it will hurt the detection performance. This problem is even more severe in few shot scenario. In this paper, we identify and solve the trigger curse problem in few shot event detection (FSED) from a causal view. By formulating FSED with a structural causal model (SCM), we found that the trigger is a confounder of the context and the result, which makes previous FSED methods much easier to overfit triggers. To resolve this problem, we propose to intervene on the context via backdoor adjustment during training. Experiments show that our method significantly improves the FSED on ACE05, MAVEN and KBP17 datasets.


Training Energy Efficient Deep Spiking Neural Networks with Single Spike Hybrid Input Encoding. Spiking Neural Networks (SNNs) have emerged as an attractive alternative to traditional deep learning frameworks, since they provide higher computational efficiency in event driven neuromorphic hardware. However, the state of the art (SOTA) SNNs suffer from high inference latency, resulting from inefficient input encoding and training techniques. The most widely used input coding schemes, such as Poisson based rate coding, do not leverage the temporal learning capabilities of SNNs. This paper presents a training framework for low latency energy efficient SNNs that uses a hybrid encoding scheme at the input layer in which the analog pixel values of an image are directly applied during the first timestep and a novel variant of spike temporal coding is used during subsequent timesteps. In particular, neurons in every hidden layer are restricted to fire at most once per image which increases activation sparsity. To train these hybrid encoded SNNs, we propose a variant of the gradient descent based spike timing dependent back propagation (STDB) mechanism using a novel cross entropy loss function based on both the output neurons' spike time and membrane potential. The resulting SNNs have reduced latency and high activation sparsity, yielding significant improvements in computational efficiency. In particular, we evaluate our proposed training scheme on image classification tasks from CIFAR 10 and CIFAR 100 datasets on several VGG architectures. We achieve top 1 accuracy of 66.46 with 5 timesteps on the CIFAR 100 dataset with sim 125 times less compute energy than an equivalent standard ANN. Additionally, our proposed SNN performs 5 300 times faster inference compared to other state of the art rate or temporally coded SNN models.


Is the Chen Sbert Divergence a Metric?. Recently, Chen and Sbert proposed a general divergence measure. This report presents some interim findings about the question whether the divergence measure is a metric or not. It has been postulated that (i) the measure might be a metric when (0 k 1), and (ii) the k th root of the measure might be a metric when (k 1). The report shows that for a 2 letter alphabet, postulation (i) can be proved. The possible pathway for obtaining a proof for (i) in n letter cases is also discussed. The authors hope that the report may stimulate more scholarly effort to study the mathematical properties of this divergence measure.


T product Tensors Part I Inequalities. The T product operation between two three order tensors was invented around 2011 and it arises from many applications, such as signal processing, image feature extraction, machine learning, computer vision, and the multiview clustering problem. Although there are many pioneer works about T product tensors, there are no works dedicated to inequalities associated with T product tensors. In this work, we first attempt to build inequalities at the following aspects (1) trace function nondecreasing and convexity (2) Golden Thompson inequality for T product tensors (3) Jensen T product inequality (4) Klein T product inequality. All these inequalities are related to generalize celebrated Lieb concavity theorem from matrices to T product tensors. This new version of Lieb concavity theorem under T product tensor will be used to determine the tail bound for the maximum eigenvalue induced by independent sums of random Hermitian T product, which is the key tool to derive various new tail bounds for random T product tensors. Besides, Qi et. al introduces a new concept, named eigentuple, about T product tensors and they apply this concept to study nonnegative (positive) definite properties of T product tensors. The final main contribution of this work is to develop the Courant Fischer Theorem with respect to eigentuples, and this theorem helps us to understand the relationship between the minimum eigentuple and the maximum eigentuple. The main content of this paper is Part I of a serious task about T product tensors. The Part II of this work will utilize these new inequalities and Courant Fischer Theorem under T product tensors to derive tail bounds of the extreme eigenvalue and the maximum eigentuple for sums of random T product tensors, e.g., T product tensor Chernoff and T product tensor Bernstein bounds.


Transfers on commutative group schemes. We prove that any commutative group scheme separated over a noetherian normal scheme admits a canonical structure of a presheaf with transfers, which is characterized by a simple condition on radicial transfers.


Abelian invariants and a reduction theorem for the modular isomorphism problem. We show that elementary abelian direct factors can be disregarded in the study of the modular isomorphism problem. Moreover, we obtain four new series of abelian invariants of the group base in the modular group algebra of a finite p group. Finally, we apply our results to new classes of groups.


Learning to Estimate Robust 3D Human Mesh from In the Wild Crowded Scenes. We consider the problem of recovering a single person's 3D human mesh from in the wild crowded scenes. While much progress has been in 3D human mesh estimation, existing methods struggle when test input has crowded scenes. The first reason for the failure is a domain gap between training and testing data. A motion capture dataset, which provides accurate 3D labels for training, lacks crowd data and impedes a network from learning crowded scene robust image features of a target person. The second reason is a feature processing that spatially averages the feature map of a localized bounding box containing multiple people. Averaging the whole feature map makes a target person's feature indistinguishable from others. We present 3DCrowdNet that firstly explicitly targets in the wild crowded scenes and estimates a robust 3D human mesh by addressing the above issues. First, we leverage 2D human pose estimation that does not require a motion capture dataset with 3D labels for training and does not suffer from the domain gap. Second, we propose a joint based regressor that distinguishes a target person's feature from others. Our joint based regressor preserves the spatial activation of a target by sampling features from the target's joint locations and regresses human model parameters. As a result, 3DCrowdNet learns target focused features and effectively excludes the irrelevant features of nearby persons. We conduct experiments on various benchmarks and prove the robustness of 3DCrowdNet to the in the wild crowded scenes both quantitatively and qualitatively. Codes are available in https github.com hongsukchoi 3DCrowdNet RELEASE.


Marcinkiewicz regularity for singular parabolic p Laplace type equations with measure data. We consider quasilinear parabolic equations with measurable coefficients when the right hand side is a signed Radon measure with finite total mass, having p Laplace type u t textrm div , mathbf a (Du,x,t) mu quad textrm in Omega times (0,T) subset mathbb R n times mathbb R . In the singular range frac 2n n 1 p le 2 frac 1 n 1 , we establish regularity estimates for the spatial gradient of solutions in the Marcinkiewicz spaces, under a suitable density condition of the right hand side measure.


On a family of cubic Thue Equations involving Fibonacci and Lucas numbers. Let F n denote the n th Fibonacci number and L n the n th Lucas number. We completely solve the family of cubic Thue equations (X F nY)(X L nY)X Y 3 pm1 and show that there are no non trivial solutions for n neq 1,3 .


Anosov representations as holonomies of globally hyperbolic spatially compact conformally flat spacetimes. Anosov representations were introduced by F. Labourie 18 for fundamental groups of closed negatively curved surfaces, and generalized by O. Guichard and A. Wienhard 19 to representations of arbitrary Gromov hyperbolic groups into real semisimple Lie groups. In this paper, we focus on Anosov representations into the identity component O0(2, n) of O(2, n) for n ge 2. Our main result is that any Anosov representation with negative limit set as defined in 8 is the holonomy group of a spatially compact, globally hyperbolic maximal (abbrev. CGHM) conformally flat spacetime. The proof of the spatial compactness needs a particular care. The key idea is to notice that for any spacetime M , the space of lightlike geodesics of M is homeomorphic to the unit tangent bundle of a Cauchy hypersurface of M. For this purpose, we introduce the space of causal geodesics containing timelike and lightlike geodesics of anti de Sitter space and lightlike geodesics of its conformal boundary the Einstein spacetime. The spatial compactness is a consequence of the following theorem Any Anosov representation acts properly discontinuously by isometries on the set of causal geodesics avoiding the limit set besides, this action is cocompact. It is stated in a general setting by O. Guichard, F. Kassel and A. Wienhard in 11 . We can see this last result as a Lorentzian analogue of the action of convex cocompact Kleinian group on the complementary of the limit set in H n. Lastly, we show that the conformally flat spacetime in our main result is the union of two conformal copies of a strongly causal AdS spacetime with boundary which contains when the limit set is not a topological (n 1) sphere a globally hyperbolic region having the properties of a black hole as defined in 2 , 3 , 4 .


Electrically controlled self similar evolution of viscous fingering patterns in radial Hele Shaw flows. Time dependent injection strategies are commonly employed to control the number of viscous fingers emerging at the interface separating two fluids during radial displacement in Hele Shaw flows. Here we demonstrate theoretically that such a usual controlling method is significantly improved by taking advantage of an electro osmotic flow generated by applying an external electric field. More specifically, under the coupled action of time varying electric currents and injection rates, we design a strategy capable of controlling not only the number of fingers emerging at the interface but also when (and if) the self similar evolution occurs. In addition, the level of instability of the n fold fingered patterns can also be tuned. This improved control over the interfacial features cannot be realized by the sole consideration of a time varying injection rate. Perturbative second order mode coupling analysis and boundary integral simulations confirm that the validity and effectiveness of the controlling protocol go beyond the linear regime.


Matters Arising in "Plasmon driven carbon fluorine (C(sp 3 ) F) bond activation with mechanistic insights into hot carrier mediated pathways". In a recent paper Nature Catalysis 3, 573 (2020) , Robatjazi em et al. demonstrate hydrodefluorination on Al nanocrystals decorated by Pd islands under illumination and under external heating. They conclude that photocatalysis accomplishes the desired transformation ce CH3F D2 CH3D DF efficiently and selectively due to "hot" electrons, as evidenced by an illumination induced reduction of the activation energy. Although some of the problems identified in prior work by the same group have been addressed, scrutiny of the data in Nature Catalysis 3, 573 (2020) raises doubts about both the methodology and the central conclusions. First, we show that the thermal control experiments in Nature Catalysis 3, 573 (2020) do not separate thermal from "hot electron" contributions, and therefore any conclusions drawn from these experiments are invalid. We then show that an improved thermal control implies that the activation energy of the reaction does not change, and that an independent purely thermal calculation (based solely on the sample parameters provided in the original manuscript) explains the measured data perfectly. For the sake of completeness, we also address technical problems in the calibration of the thermal camera, an unjustifiable disqualification of some of the measured data, as well as concerning aspects of the rest of the main results, including the mass spectrometry approach used to investigate the selectivity of the reaction, and claims about the stoichiometry and reaction order. All this shows that the burden of proof for involvement of hot electrons has not been met.


Three dimensional Rep tiles. A 3D rep tile is a compact 3 manifold X in mathbb R 3 that can be decomposed into finitely many pieces, each of which are similar to X , and all of which are congruent to each other. In this paper we classify all 3D rep tiles up to homeomorphism. In particular, we show that a 3 manifold is homeomorphic to a 3D rep tile if and only if it is the exterior of a connected graph in S 3 .


On Efficient Aggregation of Distributed Energy Resources. The rapid expansion of distributed energy resources (DERs) is one of the most significant changes to electricity systems around the world. Examples of DERs include solar panels, small natural gas fueled generators, combined heat and power plants, etc. Due to the small supply capacities of these DERs, it is impractical for them to participate directly in the wholesale electricity market. We study in this paper an efficient aggregation model where a profit maximizing aggregator procures electricity from DERs, and sells them in the wholesale market. The interaction between the aggregator and the DER owners is modeled as a Stackelberg game the aggregator adopts two part pricing by announcing a participation fee and a per unit price of procurement for each DER owner, and the DER owner responds by choosing her payoff maximizing energy supplies. We show that our proposed model preserves full market efficiency, i.e., the social welfare achieved by the aggregation model is the same as that when DERs participate directly in the wholesale market. We also note that two part pricing is critical for market efficiency, and illustrate via an example that with one part pricing, there will be an efficiency loss from DER aggregation, due to the profit seeking behavior of the aggregator.


A Model Driven Approach to Reengineering Processes in Cloud Computing. The reengineering process of large data intensive legacy software applications to cloud platforms involves different interrelated activities. These activities are related to planning, architecture design, re hosting lift shift, code refactoring, and other related ones. In this regard, the cloud computing literature has seen the emergence of different methods with a disparate point of view of the same underlying legacy application reengineering process to cloud platforms. As such, the effective interoperability and tailoring of these methods become problematic due to the lack of integrated and consistent standard models.


Multi Modal Interaction Graph Convolutional Network for Temporal Language Localization in Videos. This paper focuses on tackling the problem of temporal language localization in videos, which aims to identify the start and end points of a moment described by a natural language sentence in an untrimmed video. However, it is non trivial since it requires not only the comprehensive understanding of the video and sentence query, but also the accurate semantic correspondence capture between them. Existing efforts are mainly centered on exploring the sequential relation among video clips and query words to reason the video and sentence query, neglecting the other intra modal relations (e.g., semantic similarity among video clips and syntactic dependency among the query words). Towards this end, in this work, we propose a Multi modal Interaction Graph Convolutional Network (MIGCN), which jointly explores the complex intra modal relations and inter modal interactions residing in the video and sentence query to facilitate the understanding and semantic correspondence capture of the video and sentence query. In addition, we devise an adaptive context aware localization method, where the context information is taken into the candidate moments and the multi scale fully connected layers are designed to rank and adjust the boundary of the generated coarse candidate moments with different lengths. Extensive experiments on Charades STA and ActivityNet datasets demonstrate the promising performance and superior efficiency of our model.


Polynomials that preserve nonnegative matrices of order two. A known characterization for entire functions that preserve all nonnegative matrices of order two is shown to characterize polynomials that preserve nonnegative matrices of order two. Equivalent conditions are derived and used to prove that mathscr P 3 subset mathscr P 2 , which was previously unknown. A new characterization is given for polynomials that preserve nonnegative circulant matrices of order two.


On the representation theory of the vertex algebra L 5 2 (sl(4)) . We study the representation theory of non admissible simple affine vertex algebra L 5 2 (sl(4)) . We determine an explicit formula for the singular vector of conformal weight four in the universal affine vertex algebra V 5 2 (sl(4)) , and show that it generates the maximal ideal in V 5 2 (sl(4)) . We classify irreducible L 5 2 (sl(4)) modules in the category mathcal O , and determine the fusion rules between irreducible modules in the category of ordinary modules KL 5 2 . It turns out that this fusion algebra is isomorphic to the fusion algebra of KL 1 . We also prove that KL 5 2 is a semi simple, rigid braided tensor category. In our proofs we use the notion of collapsing level for the affine mathcal W algebra, and the properties of conformal embedding gl(4) hookrightarrow sl(5) at level k 5 2 from arXiv 1509.06512. We show that k 5 2 is a collapsing level with respect to the subregular nilpotent element f subreg , meaning that the simple quotient of the affine mathcal W algebra W 5 2 (sl(4), f subreg ) is isomorphic to the Heisenberg vertex algebra M J(1) . We prove certain results on vanishing and non vanishing of cohomology for the quantum Hamiltonian reduction functor H f subreg . It turns out that the properties of H f subreg are more subtle than in the case of minimal reducition.


Adversarial Examples can be Effective Data Augmentation for Unsupervised Machine Learning. Adversarial examples causing evasive predictions are widely used to evaluate and improve the robustness of machine learning models. However, current studies focus on supervised learning tasks, relying on the ground truth data label, a targeted objective, or supervision from a trained classifier. In this paper, we propose a framework of generating adversarial examples for unsupervised models and demonstrate novel applications to data augmentation. Our framework exploits a mutual information neural estimator as an information theoretic similarity measure to generate adversarial examples without supervision. We propose a new MinMax algorithm with provable convergence guarantees for efficient generation of unsupervised adversarial examples. Our framework can also be extended to supervised adversarial examples. When using unsupervised adversarial examples as a simple plug in data augmentation tool for model retraining, significant improvements are consistently observed across different unsupervised tasks and datasets, including data reconstruction, representation learning, and contrastive learning. Our results show novel methods and considerable advantages in studying and improving unsupervised machine learning via adversarial examples.


Dialogue State Tracking with Multi Level Fusion of Predicted Dialogue States and Conversations. Most recently proposed approaches in dialogue state tracking (DST) leverage the context and the last dialogue states to track current dialogue states, which are often slot value pairs. Although the context contains the complete dialogue information, the information is usually indirect and even requires reasoning to obtain. The information in the lastly predicted dialogue states is direct, but when there is a prediction error, the dialogue information from this source will be incomplete or erroneous. In this paper, we propose the Dialogue State Tracking with Multi Level Fusion of Predicted Dialogue States and Conversations network (FPDSC). This model extracts information of each dialogue turn by modeling interactions among each turn utterance, the corresponding last dialogue states, and dialogue slots. Then the representation of each dialogue turn is aggregated by a hierarchical structure to form the passage information, which is utilized in the current turn of DST. Experimental results validate the effectiveness of the fusion network with 55.03 and 59.07 joint accuracy on MultiWOZ 2.0 and MultiWOZ 2.1 datasets, which reaches the state of the art performance. Furthermore, we conduct the deleted value and related slot experiments on MultiWOZ 2.1 to evaluate our model.


Aleksandrov's estimates for elliptic equations with drift in Morrey spaces containing L d . In this note, we obtain a version of Aleksandrov's maximum principle when the drift coefficients are in Morrey spaces, which contains L d , and when the free term is in L p for some p d .


von Mises Fisher Loss An Exploration of Embedding Geometries for Supervised Learning. Recent work has argued that classification losses utilizing softmax cross entropy are superior not only for fixed set classification tasks, but also by outperforming losses developed specifically for open set tasks including few shot learning and retrieval. Softmax classifiers have been studied using different embedding geometries Euclidean, hyperbolic, and spherical and claims have been made about the superiority of one or another, but they have not been systematically compared with careful controls. We conduct an empirical investigation of embedding geometry on softmax losses for a variety of fixed set classification and image retrieval tasks. An interesting property observed for the spherical losses lead us to propose a probabilistic classifier based on the von Mises Fisher distribution, and we show that it is competitive with state of the art methods while producing improved out of the box calibration. We provide guidance regarding the trade offs between losses and how to choose among them.


Two new compartmental epidemiological models and their equilibria. Compartmental models have long served as important tools in mathematical epidemiology, with their usefulness highlighted by the recent COVID 19 pandemic. However, most of the classical models fail to account for certain features of this disease and others like it, such as the ability of exposed individuals to recover without becoming infectious, or the possibility that asymptomatic individuals can indeed transmit the disease but at a lesser rate than the symptomatic. Furthermore, the rise of new disease variants and the imperfection of vaccines suggest that concept of endemic equilibrium is perhaps more pertinent than that of herd immunity. Here we propose a new compartmental epidemiological model and study its equilibria, characterizing the stability of both the endemic and disease free equilibria in terms of the basic reproductive number. Moreover, we introduce a second compartmental model, generalizing our first, which accounts for vaccinated individuals, and begin an analysis of its equilibria.


It Takes Two to Tango Combining Visual and Textual Information for Detecting Duplicate Video Based Bug Reports. When a bug manifests in a user facing application, it is likely to be exposed through the graphical user interface (GUI). Given the importance of visual information to the process of identifying and understanding such bugs, users are increasingly making use of screenshots and screen recordings as a means to report issues to developers. However, when such information is reported en masse, such as during crowd sourced testing, managing these artifacts can be a time consuming process. As the reporting of screen recordings in particular becomes more popular, developers are likely to face challenges related to manually identifying videos that depict duplicate bugs. Due to their graphical nature, screen recordings present challenges for automated analysis that preclude the use of current duplicate bug report detection techniques. To overcome these challenges and aid developers in this task, this paper presents Tango, a duplicate detection technique that operates purely on video based bug reports by leveraging both visual and textual information. Tango combines tailored computer vision techniques, optical character recognition, and text retrieval. We evaluated multiple configurations of Tango in a comprehensive empirical evaluation on 4,860 duplicate detection tasks that involved a total of 180 screen recordings from six Android apps. Additionally, we conducted a user study investigating the effort required for developers to manually detect duplicate video based bug reports and compared this to the effort required to use Tango. The results reveal that Tango's optimal configuration is highly effective at detecting duplicate video based bug reports, accurately ranking target duplicate videos in the top 2 returned results in 83 of the tasks. Additionally, our user study shows that, on average, Tango can reduce developer effort by over 60 , illustrating its practicality.


Spatiotemporal control of surface plasmon polariton wave packets with nanocavities. Modulation of the optical index by means of atomic and material resonances provides a basis for controlling light propagation in natural and artificially fabricated materials. In addition, recent advances in the tuning of spatiotemporal couplings of ultrashort laser pulses have enabled almost arbitrary control over the group velocity of light. Here, using femtosecond time resolved microscopy and numerical calculations, we investigate the spatiotemporal dynamics of a surface plasmon polariton wave packet (SPP WP) that interacts with a plasmonic nanocavity. The nanocavity consists of metal insulator metal multilayer films that function as subwavelength meta atom possessing tunable discretized eigenmodes. When a chirp induced femtosecond SPP WP is incident on a nanocavity, only the spectral component matching the resonance energy is transmitted. This spectral clipping effect is accompanied by a spatial shift of the WP. The shift can be adjusted in either the positive or negative direction by controlling the resonance energy or the chirp. If this spatial shift is regarded as a modulation of the apparent group velocity in the nanocavity, the range of modulation includes superluminal, subluminal, and negative group velocities.


Discrepancies in the distribution of Gaussian primes. Motivated by questions of Fouvry and Rudnick on the distribution of Gaussian primes, we develop a very general setting in which one can study inequities in the distribution of analogues of primes through analytic properties of infinitely many L functions. In particular, we give a heuristic argument for the following claim for more than half of the prime numbers that can be written as a sum of two square, the odd square is the square of a positive integer congruent to 1 bmod 4 .


A proton simulator for testing implementations of proton CT reconstruction algorithms on GPGPU clusters. Proton computed tomography (pCT) is an image modality that will improve treatment planning for patients receiving proton radiation therapy compared with the current treatment techniques, which are based on X ray CT. Reconstruction of a pCT image requires solving a large and sparse system of linear equations, which should be accomplished within a few minutes in order to be clinically practical. Analyzing the efficiency of potentially clinical reconstruction implementations requires multiple quality pCT data sets. The purpose of this paper is to describe the simulator that was developed to generate realistic pCT data sets to be used in testing the efficiency of reconstruction algorithms, in particular string averaging and block iterative projection algorithms using sparse matrix formats on General Purpose Graphics Processing Units (GPGPU)s.


Lightning Striking the Secure Isolation on GPU Clouds with Transient Hardware Faults. GPU clouds have become a popular computing platform because of the cost of owning and maintaining high performance computing clusters. Many cloud architectures have also been proposed to ensure a secure execution environment for guest applications by enforcing strong security policies to isolate the untrusted hypervisor from the guest virtual machines (VMs). In this paper, we study the impact of GPU chip's hardware faults on the security of cloud "trusted" execution environment using Deep Neural Network (DNN) as the underlying application. We show that transient hardware faults of GPUs can be generated by exploiting the Dynamic Voltage and Frequency Scaling (DVFS) technology, and these faults may cause computation errors, but they have limited impact on the inference accuracy of DNN due to the robustness and fault tolerant nature of well developed DNN models. To take full advantage of these transient hardware faults, we propose the Lightning attack to locate the fault injection targets of DNNs and to control the fault injection precision in terms of timing and position. We conduct experiments on three commodity GPUs to attack four widely used DNNs. Experimental results show that the proposed attack can reduce the inference accuracy of the models by as high as 78.3 and 64.5 on average. More importantly, 67.9 of the targeted attacks have successfully misled the models to give our desired incorrect inference result. This demonstrates that the secure isolation on GPU clouds is vulnerable against transient hardware faults and the computation results may not be trusted.


The Gompertz Growth of COVID 19 Outbreaks is Caused by Super Spreaders. In individual SARS CoV 2 outbreaks, the count of confirmed cases and deaths follow a Gompertz growth function for locations of very different sizes. This lack of dependence on region size leads us to hypothesize that virus spread depends on universal properties of the network of social interactions. We test this hypothesis by simulating the propagation of a virus on networks of different topologies. Our main finding is that Gompertz growth observed for early outbreaks occurs only for a scale free network, in which nodes with many more neighbors than average are common. These nodes that have very many neighbors are infected early in the outbreak and then spread the infection very rapidly. When these nodes are no longer infectious, the remaining nodes that have most neighbors take over and continue to spread the infection. In this way, the rate of spread is fastest at the very start and slows down immediately. Geometrically it is seen that the "surface" of the epidemic, the number of susceptible nodes in contact with the infected nodes, starts to rapidly decrease very early in the epidemic and as soon as the larger nodes have been infected. In our simulation, the speed and impact of an outbreak depend on three parameters the average number of contacts each node makes, the probability of being infected by a neighbor, and the probability of recovery. Intelligent interventions to reduce the impact of future outbreaks need to focus on these critical parameters in order to minimize economic and social collateral damage.


Classification of Backward Filtrations and Factor Filtrations Examples from Cellular Automata. We consider backward filtrations generated by processes coming from deterministic and probabilistic cellular automata. We prove that these filtrations are standard in the classical sense of Vershik's theory, but we also study them from another point of view that takes into account the measurepreserving action of the shift map, for which each sigma algebra in the filtrations is invariant. This initiates what we call the dynamical classification of factor filtrations, and the examples we study show that this classification leads to different results.


What are Attackers after on IoT Devices? An approach based on a multi phased multi faceted IoT honeypot ecosystem and data clustering. The growing number of Internet of Things (IoT) devices makes it imperative to be aware of the real world threats they face in terms of cybersecurity. While honeypots have been historically used as decoy devices to help researchers organizations gain a better understanding of the dynamic of threats on a network and their impact, IoT devices pose a unique challenge for this purpose due to the variety of devices and their physical connections. In this work, by observing real world attackers' behavior in a low interaction honeypot ecosystem, we (1) presented a new approach to creating a multi phased, multi faceted honeypot ecosystem, which gradually increases the sophistication of honeypots' interactions with adversaries, (2) designed and developed a low interaction honeypot for cameras that allowed researchers to gain a deeper understanding of what attackers are targeting, and (3) devised an innovative data analytics method to identify the goals of adversaries. Our honeypots have been active for over three years. We were able to collect increasingly sophisticated attack data in each phase. Furthermore, our data analytics points to the fact that the vast majority of attack activities captured in the honeypots share significant similarity, and can be clustered and grouped to better understand the goals, patterns, and trends of IoT attacks in the wild.


A Miniaturized Low Frequency (LF) Magnetoelectric Receiving Antenna with an Integrated DC Magnetic Bias. Due to the applications in meteorological broadcasts, radio navigation and underwater communications, low frequency(LF) receiving antennas have been actively studied. However, because the frequency range of LF antenna is 30kHz to 300kHz, its electromagnetic wavelength is 1km to 10km, which makes LF electromagnetic antennas difficult to be implemented in miniaturized or portable devices. This article presents a miniaturized LF magnetoelectric(ME) receiving antenna with an integrated DC magnetic bias. The antenna is based on the magnetoelectric effect and operates by resonance at its mechanical resonant frequency. Thus, compared with traditional LF wire antennas, the dimension of ME antenna is reduced significantly. Compared with prior art of ME antennas which do not have DC magnetic bias, higher performance can be achieved by integrating the miniaturized DC magnetic bias. Compared with prior art of an ME antenna with bulky external DC magnetic bias, the ME antenna with an integrated DC magnetic bias significantly reduce its dimension. Magnetostrictive TbDyFe2(Terfenol D) and piezoelectric lead zirconate titanate(PZT) thin films are bonded together to form the 38x12x5.8mm3 ME receiving antenna. Four 10x10x10mm3 Rb magnets are implemented to provide an optimal DC bias for the antenna. A maximum operation distance of 2.5m is demonstrated with the DC magnetic field bias, 2.27 times of the maximum operation distance of the antenna without DC magnet field bias. The efficiency, gain and quality factor the ME receiving antenna is also characterized. The miniaturized LF ME antenna could have potential applications in portable electronics, internet of things and underwater communications.


An SPH framework for fluid solid and contact interaction problems including thermo mechanical coupling and reversible phase transitions. The present work proposes an approach for fluid solid and contact interaction problems including thermo mechanical coupling and reversible phase transitions. The solid field is assumed to consist of several arbitrarily shaped, undeformable but mobile rigid bodies, that are evolved in time individually and allowed to get into mechanical contact with each other. The fluid field generally consists of multiple liquid or gas phases. All fields are spatially discretized using the method of smoothed particle hydrodynamics (SPH). This approach is especially suitable in the context of continually changing interface topologies and dynamic phase transitions without the need for additional methodological and computational effort for interface tracking as compared to mesh or grid based methods. Proposing a concept for the parallelization of the computational framework, in particular concerning a computationally efficient evaluation of rigid body motion, is an essential part of this work. Finally, the accuracy and robustness of the proposed framework is demonstrated by several numerical examples in two and three dimensions, involving multiple rigid bodies, two phase flow, and reversible phase transitions, with a focus on two potential application scenarios in the fields of engineering and biomechanics powder bed fusion additive manufacturing (PBFAM) and disintegration of food boluses in the human stomach. The efficiency of the parallel computational framework is demonstrated by a strong scaling analysis.


Intrusive and non intrusive reduced order modeling of the rotating thermal shallow water equation. In this paper, we investigate projection based intrusive and data driven non intrusive model order reduction methods in numerical simulation of rotating thermal shallow water equation (RTSWE) in parametric and non parametric form. Discretization of the RTSWE in space with centered finite differences leads to Hamiltonian system of ordinary differential equations with linear and quadratic terms. The full order model (FOM) is obtained by applying linearly implicit Kahan's method in time. Applying proper orthogonal decomposition with Galerkin projection (POD G), we construct the intrusive reduced order model (ROM). We apply operator inference (OpInf) with re projection for non intrusive reduced order modeling. In the parametric case, we make use of the parameter dependency at the level of the PDE without interpolating between the reduced operators. The least squares problem of the OpInf is regularized with the minimum norm solution. Both ROMs behave similar and are able to accurately predict the test and training data and capture system behavior in the prediction phase with several orders of computational speedup over the FOM. The preservation of system physics such as the conserved quantities of the RTSWE by both ROMs enables that the models fit better to data and stable solutions are obtained in long term predictions, which are robust to parameter changes.


3D Segmentation Learning from Sparse Annotations and Hierarchical Descriptors. One of the main obstacles to 3D semantic segmentation is the significant amount of endeavor required to generate expensive point wise annotations for fully supervised training. To alleviate manual efforts, we propose GIDSeg, a novel approach that can simultaneously learn segmentation from sparse annotations via reasoning global regional structures and individual vicinal properties. GIDSeg depicts global and individual relation via a dynamic edge convolution network coupled with a kernelized identity descriptor. The ensemble effects are obtained by endowing a fine grained receptive field to a low resolution voxelized map. In our GIDSeg, an adversarial learning module is also designed to further enhance the conditional constraint of identity descriptors within the joint feature distribution. Despite the apparent simplicity, our proposed approach achieves superior performance over state of the art for inferencing 3D dense segmentation with only sparse annotations. Particularly, with 5 annotations of raw data, GIDSeg outperforms other 3D segmentation methods.


Factorizations of almost simple orthogonal groups in odd dimension. This is the third one in a series of papers classifying the factorizations of almost simple groups with nonsolvable factors. In this paper we deal with orthogonal groups in odd dimension.


A Predictive Autonomous Decision Aid for Calibrating Human Autonomy Reliance in Multi Agent Task Assignment. In this work, we develop a game theoretic modeling of the interaction between a human operator and an autonomous decision aid when they collaborate in a multi agent task allocation setting. In this setting, we propose a decision aid that is designed to calibrate the operator's reliance on the aid through a sequence of interactions to improve overall human autonomy team performance. The autonomous decision aid employs a long short term memory (LSTM) neural network for human action prediction and a Bayesian parameter filtering method to improve future interactions, resulting in an aid that can adapt to the dynamics of human reliance. The proposed method is then tested against a large set of simulated human operators from the choice prediction competition (CPC18) data set, and shown to significantly improve human autonomy interactions when compared to a myopic decision aid that only suggests predicted human actions without an understanding of reliance.


CSRNet Cascaded Selective Resolution Network for Real time Semantic Segmentation. Real time semantic segmentation has received considerable attention due to growing demands in many practical applications, such as autonomous vehicles, robotics, etc. Existing real time segmentation approaches often utilize feature fusion to improve segmentation accuracy. However, they fail to fully consider the feature information at different resolutions and the receptive fields of the networks are relatively limited, thereby compromising the performance. To tackle this problem, we propose a light Cascaded Selective Resolution Network (CSRNet) to improve the performance of real time segmentation through multiple context information embedding and enhanced feature aggregation. The proposed network builds a three stage segmentation system, which integrates feature information from low resolution to high resolution and achieves feature refinement progressively. CSRNet contains two critical modules the Shorted Pyramid Fusion Module (SPFM) and the Selective Resolution Module (SRM). The SPFM is a computationally efficient module to incorporate the global context information and significantly enlarge the receptive field at each stage. The SRM is designed to fuse multi resolution feature maps with various receptive fields, which assigns soft channel attentions across the feature maps and helps to remedy the problem caused by multi scale objects. Comprehensive experiments on two well known datasets demonstrate that the proposed CSRNet effectively improves the performance for real time segmentation.


Detecting Object States vs Detecting Objects A New Dataset and a Quantitative Experimental Study. The detection of object states in images (State Detection SD) is a problem of both theoretical and practical importance and it is tightly interwoven with other important computer vision problems, such as action recognition and affordance detection. It is also highly relevant to any entity that needs to reason and act in dynamic domains, such as robotic systems and intelligent agents. Despite its importance, up to now, the research on this problem has been limited. In this paper, we attempt a systematic study of the SD problem. First, we introduce the Object State Detection Dataset (OSDD), a new publicly available dataset consisting of more than 19,000 annotations for 18 object categories and 9 state classes. Second, using a standard deep learning framework used for Object Detection (OD), we conduct a number of appropriately designed experiments, towards an in depth study of the behavior of the SD problem. This study enables the setup of a baseline on the performance of SD, as well as its relative performance in comparison to OD, in a variety of scenarios. Overall, the experimental outcomes confirm that SD is harder than OD and that tailored SD methods need to be developed for addressing effectively this significant problem.


Scheduling and dimensioning of heterogeneous energy stores, with applications to future GB storage needs. Future electricity systems in which all or most generation is renewable may require very high volumes of storage, provided jointly by a number of heterogeneous technologies, in order to manage the associated variability in the generation demand balance. We consider the problems of scheduling and dimensioning such storage. We develop a value function based approach to optimal scheduling, and show that, to a good approximation, the problem to be solved at each successive point in time reduces to a linear programme with a particularly simple solution. We show that, in general, approximately optimal scheduling may be achieved without the need for a running forecast of the future generation demand balance. We examine the applicability of the above theory to future GB storage needs, and discuss how it may be used to enable the proper dimensioning of such storage.


On p Frobenius and related numbers due to p Ap 'ery set. Let a 1,a 2, dots,a k be positive integers with gcd(a 1,a 2, dots,a k) 1 . Frobenius number is the largest positive integer that is not representable in terms of a 1,a 2, dots,a k . When k ge 3 , there is no explicit formula in general. Along with the Frobenius number, various quantities such as the number of non negative integers that cannot be represented and the total number of them have been studied. Various concepts have been proposed and studied for the similarity and generalization of the Frobenius number, but in this paper, we mainly study the generalized Frobenius number ( p Frobenius number), which focuses on the number of linear equations, and we give a formula that can comprehensively express the quantities along with it. The concept and formula of the weighted sum has been given recently. We also give a p generalized formula for such weighted sums. The central role is the p Ap 'ery set, which is a generalization of the classical Ap 'ery set.


Physics Informed Convex Artificial Neural Networks (PICANNs) for Optimal Transport based Density Estimation. Optimal Mass Transport (OMT) is a well studied problem with a variety of applications in a diverse set of fields ranging from Physics to Computer Vision and in particular Statistics and Data Science. Since the original formulation of Monge in 1781 significant theoretical progress been made on the existence, uniqueness and properties of the optimal transport maps. The actual numerical computation of the transport maps, particularly in high dimensions, remains a challenging problem. By Brenier's theorem, the continuous OMT problem can be reduced to that of solving a non linear PDE of Monge Ampere type whose solution is a convex function. In this paper, building on recent developments of input convex neural networks and physics informed neural networks for solving PDE's, we propose a Deep Learning approach to solve the continuous OMT problem. To demonstrate the versatility of our framework we focus on the ubiquitous density estimation and generative modeling tasks in statistics and machine learning. Finally as an example we show how our framework can be incorporated with an autoencoder to estimate an effective probabilistic generative model.


Design Considerations for Data Daemons Co creating Design Futures to Explore Ethical Personal Data Management. Mobile applications and online service providers track our virtual and physical behaviour more actively and with a broader scope than ever before. This has given rise to growing concerns about ethical personal data management. Even though regulation and awareness around data ethics are increasing, end users are seldom engaged when defining and designing what a future with ethical personal data management should look like. We explore a participatory process that uses design futures, the Future workshop method and design fictions to envision ethical personal data management with end users and designers. To engage participants effectively, we needed to bridge their differential expertise and make the abstract concepts of data and ethics tangible. By concretely presenting personal data management and control as fictitious entities called Data Daemons, we created a shared understanding of these abstract concepts, and empowered non expert end users and designers to become actively engaged in the design process.


Boundedness of area operators on Bergman spaces. We completely characterize the boundedness of the area operators from the Bergman spaces A p alpha( mathbb B n) to the Lebesgue spaces L q( mathbb S n) for all 0 p,q infty . For the case n 1 , some partial results were previously obtained by Wu. Especially, in the case q p and q s , we obtain the new characterizations for the area operators to be bounded. We solve the cases left open there and extend the results to n complex dimension.


Analysis of Leading Communities Contributing to arXiv Information Distribution on Twitter. To analyze the impact that arXiv is having on the world, in this paper we propose an arXiv information distribution model on Twitter, which has a three layer structure arXiv papers, information spreaders, and information collectors. First, we use the HITS algorithm to analyze the arXiv information diffusion network with users as nodes, which is created from three types of behavior on Twitter regarding arXiv papers tweeting, retweeting, and liking. Next, we extract communities from the network of information spreaders with positive authority and hub degrees using the Louvain method, and analyze the relationship and roles of information spreaders in communities using research field, linguistic, and temporal characteristics. From our analysis using the tweet and arXiv datasets, we found that information about arXiv papers circulates on Twitter from information spreaders to information collectors, and that multiple communities of information spreaders are formed according to their research fields. It was also found that different communities were formed in the same research field, depending on the research or cultural background of the information spreaders. We were able to identify two types of key persons information spreaders who lead the relevant field in the international community and information spreaders who bridge the regional and international communities using English and their native language. In addition, we found that it takes some time to gain trust as an information spreader.


System Modelling of Very Low Earth Orbit Satellites for Earth Observation. The operation of satellites in very low Earth orbit (VLEO) has been linked to a variety of benefits to both the spacecraft platform and mission design. Critically, for Earth observation (EO) missions a reduction in altitude can enable smaller and less powerful payloads to achieve the same performance as larger instruments or sensors at higher altitude, with significant benefits to the spacecraft design. As a result, renewed interest in the exploitation of these orbits has spurred the development of new technologies that have the potential to enable sustainable operations in this lower altitude range. In this paper, system models are developed for (i) novel materials that improve aerodynamic performance enabling reduced drag or increased lift production and resistance to atomic oxygen erosion and (ii) atmosphere breathing electric propulsion (ABEP) for sustained drag compensation or mitigation in VLEO. Attitude and orbit control methods that can take advantage of the aerodynamic forces and torques in VLEO are also discussed. These system models are integrated into a framework for concept level satellite design and this approach is used to explore the system level trade offs for future EO spacecraft enabled by these new technologies. A case study presented for an optical very high resolution spacecraft demonstrates the significant potential of reducing orbital altitude using these technologies and indicates possible savings of up to 75 in system mass and over 50 in development and manufacturing costs in comparison to current state of the art missions. For a synthetic aperture radar (SAR) satellite, the reduction in mass and cost with altitude were shown to be smaller, though it was noted that currently available cost models do not capture recent commercial advancements in this segment...


Decomposition Methods for Global Solutions of Mixed Integer Linear Programs. This paper introduces two decomposition based methods for two block mixed integer linear programs (MILPs), which break the original problem into a sequence of smaller MILP subproblems. The first method is based on the l1 augmented Lagrangian. The second method is based on the alternating direction method of multipliers. When the original problem has a block angular structure, the subproblems of the first block have low dimensions and can be solved in parallel. We add reverse norm cuts and augmented Lagrangian cuts to the subproblems of the second block. For both methods, we show asymptotic convergence to globally optimal solutions and present iteration upper bounds. Numerical comparisons with recent decomposition methods demonstrate the exactness and efficiency of our proposed methods.