T Grating on Nano Cavity Array based Refractive Index Sensor. We report a refractive index sensor comprising of unique T grating on top of periodic nano cavities. The sensor has two resonant modes sensitive to different regions of the structure with low inter region interference, hence allows simultaneous detection of two different analytes or more accurate detection of a single analyte. The sensor also provides a self referencing feature for a broad range of refractive index, from 1.3 to 1.5. Using the FDTD method, the sensitivities of 801.7 nm RIU and 1386.8 nm RIU have been recorded for the two modes respectively. The versatility of the structure makes the sensor a prominent candidate for biochemical and other sensing applications.


Combining Reward and Rank Signals for Slate Recommendation. We consider the problem of slate recommendation, where the recommender system presents a user with a collection or slate composed of K recommended items at once. If the user finds the recommended items appealing then the user may click and the recommender system receives some feedback. Two pieces of information are available to the recommender system was the slate clicked? (the reward), and if the slate was clicked, which item was clicked? (rank). In this paper, we formulate several Bayesian models that incorporate the reward signal (Reward model), the rank signal (Rank model), or both (Full model), for non personalized slate recommendation. In our experiments, we analyze performance gains of the Full model and show that it achieves significantly lower error as the number of products in the catalog grows or as the slate size increases.


Exact Shapley Values for Local and Model True Explanations of Decision Tree Ensembles. Additive feature explanations using Shapley values have become popular for providing transparency into the relative importance of each feature to an individual prediction of a machine learning model. While Shapley values provide a unique additive feature attribution in cooperative game theory, the Shapley values that can be generated for even a single machine learning model are far from unique, with theoretical and implementational decisions affecting the resulting attributions. Here, we consider the application of Shapley values for explaining decision tree ensembles and present a novel approach to Shapley value based feature attribution that can be applied to random forests and boosted decision trees. This new method provides attributions that accurately reflect details of the model prediction algorithm for individual instances, while being computationally competitive with one of the most widely used current methods. We explain the theoretical differences between the standard and novel approaches and compare their performance using synthetic and real data.


Model Agnostic Meta Attack Towards Reliable Evaluation of Adversarial Robustness. The vulnerability of deep neural networks to adversarial examples has motivated an increasing number of defense strategies for promoting model robustness. However, the progress is usually hampered by insufficient robustness evaluations. As the de facto standard to evaluate adversarial robustness, adversarial attacks typically solve an optimization problem of crafting adversarial examples with an iterative process. In this work, we propose a Model Agnostic Meta Attack (MAMA) approach to discover stronger attack algorithms automatically. Our method learns the optimizer in adversarial attacks parameterized by a recurrent neural network, which is trained over a class of data samples and defenses to produce effective update directions during adversarial example generation. Furthermore, we develop a model agnostic training algorithm to improve the generalization ability of the learned optimizer when attacking unseen defenses. Our approach can be flexibly incorporated with various attacks and consistently improves the performance with little extra computational cost. Extensive experiments demonstrate the effectiveness of the learned attacks by MAMA compared to the state of the art attacks on different defenses, leading to a more reliable evaluation of adversarial robustness.


TypeNet Deep Learning Keystroke Biometrics. We study the performance of Long Short Term Memory networks for keystroke biometric authentication at large scale in free text scenarios. For this we explore the performance of Long Short Term Memory (LSTMs) networks trained with a moderate number of keystrokes per identity and evaluated under different scenarios including i) three learning approaches depending on the loss function (softmax, contrastive, and triplet loss) ii) different number of training samples and lengths of keystroke sequences iii) four databases based on two device types (physical vs touchscreen keyboard) and iv) comparison with existing approaches based on both traditional statistical methods and deep learning architectures. Our approach called TypeNet achieves state of the art keystroke biometric authentication performance with an Equal Error Rate of 2.2 and 9.2 for physical and touchscreen keyboards, respectively, significantly outperforming previous approaches. Our experiments demonstrate a moderate increase in error with up to 100,000 subjects, demonstrating the potential of TypeNet to operate at an Internet scale. To the best of our knowledge, the databases used in this work are the largest existing free text keystroke databases available for research with more than 136 million keystrokes from 168,000 subjects in physical keyboards, and 60,000 subjects with more than 63 million keystrokes acquired on mobile touchscreens.


Tropical Poincar 'e duality spaces. The tropical fundamental class of a rational balanced polyhedral fan induces cap products between tropical cohomology and tropical Borel Moore homology. When all these cap products are isomorphisms, the fan is said to be a tropical Poincar 'e duality space. If all the stars of faces also are such spaces, such as for fans of matroids, the fan is called a local tropical Poincar 'e duality space. In this article, we first give some necessary conditions for fans to be tropical Poincar 'e duality spaces and a classification in dimension one. Next, we prove that tropical Poincar 'e duality for the stars of all faces of dimension greater than zero and a vanishing condition implies tropical Poincar 'e duality of the fan. This leads to necessary and sufficient conditions for a fan to be a local tropical Poincar 'e duality space. Finally, we use such fans to show that certain abstract balanced polyhedral spaces satisfy tropical Poincar 'e duality.


Evaluating Relaxations of Logic for Neural Networks A Comprehensive Study. Symbolic knowledge can provide crucial inductive bias for training neural models, especially in low data regimes. A successful strategy for incorporating such knowledge involves relaxing logical statements into sub differentiable losses for optimization. In this paper, we study the question of how best to relax logical expressions that represent labeled examples and knowledge about a problem we focus on sub differentiable t norm relaxations of logic. We present theoretical and empirical criteria for characterizing which relaxation would perform best in various scenarios. In our theoretical study driven by the goal of preserving tautologies, the Lukasiewicz t norm performs best. However, in our empirical analysis on the text chunking and digit recognition tasks, the product t norm achieves best predictive performance. We analyze this apparent discrepancy, and conclude with a list of best practices for defining loss functions via logic.


DP SSL Towards Robust Semi supervised Learning with A Few Labeled Samples. The scarcity of labeled data is a critical obstacle to deep learning. Semi supervised learning (SSL) provides a promising way to leverage unlabeled data by pseudo labels. However, when the size of labeled data is very small (say a few labeled samples per class), SSL performs poorly and unstably, possibly due to the low quality of learned pseudo labels. In this paper, we propose a new SSL method called DP SSL that adopts an innovative data programming (DP) scheme to generate probabilistic labels for unlabeled data. Different from existing DP methods that rely on human experts to provide initial labeling functions (LFs), we develop a multiple choice learning (MCL) based approach to automatically generate LFs from scratch in SSL style. With the noisy labels produced by the LFs, we design a label model to resolve the conflict and overlap among the noisy labels, and finally infer probabilistic labels for unlabeled samples. Extensive experiments on four standard SSL benchmarks show that DP SSL can provide reliable labels for unlabeled data and achieve better classification performance on test sets than existing SSL methods, especially when only a small number of labeled samples are available. Concretely, for CIFAR 10 with only 40 labeled samples, DP SSL achieves 93.82 annotation accuracy on unlabeled data and 93.46 classification accuracy on test data, which are higher than the SOTA results.


Problems with Risk Matrices Using Ordinal Scales. In this paper, we discuss various problems in the usage and definition of risk matrices. We give an overview of the general process of risk assessment with risk matrices and ordinal scales. Furthermore, we explain the fallacies in each phase of this process and give hints on which decisions may lead to more problems than others and how to avoid them. Among those 24 discussed problems are ordinal scales, semi quantitative arithmetics, range compression, risk inversion, ambiguity, and neglection of uncertainty. Finally, we make a case for avoiding risk matrices altogether and instead propose using fully quantitative risk assessment methods.


H "older estimates and asymptotic behaviors of solutions of some degenerate elliptic equations on half spaces. In this paper we report the asymptotic behaviors of viscosity solutions of the following degenerate elliptic equations begin equation label main Eq Lu x n 2 alpha sum i,j 1 n 1 a ij (x)D ij u(x) 2x n alpha sum i 1 n 1 a in (x)D in u(x) D nn u(x) 0 end equation outside a bounded domain of the upper half space for alpha 0 with proper coefficients. Meanwhile, the H "older estimates up to the boundary will be obtained using rescaling methods.


Lex Rosetta Transfer of Predictive Models Across Languages, Jurisdictions, and Legal Domains. In this paper, we examine the use of multi lingual sentence embeddings to transfer predictive models for functional segmentation of adjudicatory decisions across jurisdictions, legal systems (common and civil law), languages, and domains (i.e. contexts). Mechanisms for utilizing linguistic resources outside of their original context have significant potential benefits in AI Law because differences between legal systems, languages, or traditions often block wider adoption of research outcomes. We analyze the use of Language Agnostic Sentence Representations in sequence labeling models using Gated Recurrent Units (GRUs) that are transferable across languages. To investigate transfer between different contexts we developed an annotation scheme for functional segmentation of adjudicatory decisions. We found that models generalize beyond the contexts on which they were trained (e.g., a model trained on administrative decisions from the US can be applied to criminal law decisions from Italy). Further, we found that training the models on multiple contexts increases robustness and improves overall performance when evaluating on previously unseen contexts. Finally, we found that pooling the training data from all the contexts enhances the models' in context performance.


Proximal Iteration for Deep Reinforcement Learning. We employ Proximal Iteration for value function optimization in deep reinforcement learning. Proximal Iteration is a computationally efficient technique that enables biasing the optimization procedure towards desirable solutions. As a concrete application, we endow the objective function of Deep Q Network (DQN) and Rainbow agents with a proximal term to ensure robustness in presence of large noise. The resultant agents, which we call DQN Pro and Rainbow Pro, exhibit significant improvements over their original counterparts on the Atari benchmark. Our results accentuate the power of employing sound optimization techniques for deep reinforcement learning.


Machine learning models for prediction of droplet collision outcomes. Predicting the outcome of liquid droplet collisions is an extensively studied phenomenon but the current physics based models for predicting the outcomes are poor (accuracy approx 43 ). The key weakness of these models is their limited complexity. They only account for 3 features while there are many more relevant features that go unaccounted for. This limitation of traditional models can be easily overcome through machine learning modeling of the problem. In an ML setting this problem directly translates to a classification problem with 4 classes. Here we compile a large labelled dataset and tune different ML classifiers over this dataset. We evaluate the accuracy and robustness of the classifiers. ML classifiers, with accuracies over 90 , significantly outperform the physics based models. Another key question we try to answer in this paper is whether existing knowledge of the physics based models can be exploited to boost the accuracy of the ML classifiers. We find that while this knowledge improves the accuracy marginally for small datasets, it does not improve accuracy with if larger datasets are used for training the models.


K theory and polynomial functors. We show that the algebraic K theory space of stable infinity categories is canonically functorial in polynomial functors.


Existence of solutions to nonlinear parabolic equations via majorant integral kernel. We establish the existence of solutions to the Cauchy problem for a large class of nonlinear parabolic equations including fractional semilinear parabolic equations, higher order semilinear parabolic equations, and viscous Hamilton Jacobi equations by using the majorant kernel introduced in K. Ishige, T. Kawakami, and S. Okabe, Ann. Inst. H. Poincar 'e Anal. Non Lin 'eaire 37 (2020), 1185 1209 .


How the Analyzer can Help the User Help the Analyzer. The automation offered by modern program proof tools goes hand in hand with the capability to interact with the tool when the verification fails. The SPARK proof tool tries to help the user by providing the right information, so that the user can help the tool complete the proof. In this article, we present these mechanisms and how they work concretely on a simple running example.


Global ionospheric response to a periodic sequence of HSS CIR events during the 2007 2008 solar minimum. In this study, we investigate the global ionospheric impact of high speed solar wind streams corotating interaction regions (HSS CIR). A series of ten such events are identified between December 1st 2007 and April 29th 2008, characterized in the frequency domain by the main spectral peaks corresponding to 27, 13.5, 9 and 6.75 days. The spectra of solar wind magnetic field, speed and proton density, as well as those of the geomagnetic indices AE and SYM H are solely dominated by these features. By contrast, the ionospheric NmF2 and to a lesser extent the hmF2 spectra have a much more complex structure, with secondary peaks adding to or replacing the main ones. We argue that this is evidence of the nonlinear nature of the magnetosphere ionosphere coupling, highlighted particularly in the NmF2 ionospheric response. Additionally, we show that hmF2 is more closely correlated than NmF2 to all parameters describing the solar wind and geomagnetic activity. Finally, the ionospheric response shows higher correlation with Bz than any other solar wind parameter, and higher with SYM H than AE, indicating that for the low frequency part of the spectrum, high latitude Joule heating and particle precipitation play a secondary role to that of prompt penetration electric fields in dictating the ionospheric response to geomagnetic activity, in the case of this sequence of HSS CIR events.


The Ultraviolet Index is well estimated by the terrestrial irradiance at 310nm. Ultraviolet (UV) exposure significantly contributes to non melanoma skin cancer. In the context of health, UV exposure is the product of time and the UV Index (UVI), a weighted sum of the irradiance I(lambda) over all wavelengths from lambda 250 to 400nm. In our analysis of the United States Environmental Protection Agency's UV Net database of over four hundred thousand spectral irradiance measurements taken over several years, we found that the UVI is well estimated by UVI 77 I(310nm). To better understand this result, we applied an optical atmospheric model of the terrestrial irradiance spectra and found that it applies across a wide range of conditions.


Understanding Continual Learning Settings with Data Distribution Drift Analysis. Classical machine learning algorithms often assume that the data are drawn i.i.d. from a stationary probability distribution. Recently, continual learning emerged as a rapidly growing area of machine learning where this assumption is relaxed, namely, where the data distribution is non stationary, i.e., changes over time. However, data distribution drifts may interfere with the learning process and erase previously learned knowledge thus, continual learning algorithms must include specialized mechanisms to deal with such distribution drifts. A distribution drift may change the class labels distribution, the input distribution, or both. Moreover, distribution drifts might be abrupt or gradual. In this paper, we aim to identify and categorize different types of data distribution drifts and potential assumptions about them, to better characterize various continual learning scenarios. Moreover, we propose to use the distribution drift framework to provide more precise definitions of several terms commonly used in the continual learning field.


Ask Me or Tell Me? Enhancing the Effectiveness of Crowdsourced Design Feedback. Crowdsourced design feedback systems are emerging resources for getting large amounts of feedback in a short period of time. Traditionally, the feedback comes in the form of a declarative statement, which often contains positive or negative sentiment. Prior research has shown that overly negative or positive sentiment can strongly influence the perceived usefulness and acceptance of feedback and, subsequently, lead to ineffective design revisions. To enhance the effectiveness of crowdsourced design feedback, we investigate a new approach for mitigating the effects of negative or positive feedback by combining open ended and thought provoking questions with declarative feedback statements. We conducted two user studies to assess the effects of question based feedback on the sentiment and quality of design revisions in the context of graphic design. We found that crowdsourced question based feedback contains more neutral sentiment than statement based feedback. Moreover, we provide evidence that presenting feedback as questions followed by statements leads to better design revisions than question or statement based feedback alone.


Global Existence and Large Time Behaviors of Strong Solutions to the Kinetic Cucker Smale Model Coupled with the Three Dimensional Incompressible Navier Stokes Equations. In this paper, we study global existence and large time behaviors of strong solutions to the kinetic Cucker Smale model coupled with the three dimensional incompressible Navier Stokes equations in the whole space. Using the maximal regularity estimate on the Stokes equations, global in time strong solutions to the Cauchy problem of the coupled system are obtained under small initial data regime. The optimal decay rate of the system, in the sense that the energy of the system decays at a rate coinciding with the one corresponding to the underling incompressible Navier Stokes equations without the coupling term, is also analyzed. Compared with previous results set in spatial periodic or bounded domains, we circumvent the difficulty caused by unboundedness of the domain using the Fourier splitting method.


Option Pricing under Bayesian MS VAR Process. In this paper, we have studied option pricing methods that are based on a Bayesian Markov Switching Vector Autoregressive (MS BVAR) process using a risk neutral valuation approach. A BVAR process which is a special case of the Bayesian MS VAR process is widely used to model inter dependencies of economic variables and forecast economic variables. Here we assumed that a regime switching process is generated by a homogeneous Markov process and for a normal system, a residual process follows a conditional heteroscedastic model. With a direct calculation and change of probability measure, for some frequently used options, we derive pricing formulas. An advantage of our model is it depends on economic variables and is easy to use compared to previous option pricing papers which depend on regime switching.


Optimizing Optimizers Regret optimal gradient descent algorithms. The need for fast and robust optimization algorithms are of critical importance in all areas of machine learning. This paper treats the task of designing optimization algorithms as an optimal control problem. Using regret as a metric for an algorithm's performance, we study the existence, uniqueness and consistency of regret optimal algorithms. By providing first order optimality conditions for the control problem, we show that regret optimal algorithms must satisfy a specific structure in their dynamics which we show is equivalent to performing dual preconditioned gradient descent on the value function generated by its regret. Using these optimal dynamics, we provide bounds on their rates of convergence to solutions of convex optimization problems. Though closed form optimal dynamics cannot be obtained in general, we present fast numerical methods for approximating them, generating optimization algorithms which directly optimize their long term regret. Lastly, these are benchmarked against commonly used optimization algorithms to demonstrate their effectiveness.


Sentiment Analysis for Troll Detection on Weibo. The impact of social media on the modern world is difficult to overstate. Virtually all companies and public figures have social media accounts on popular platforms such as Twitter and Facebook. In China, the micro blogging service provider, Sina Weibo, is the most popular such service. To influence public opinion, Weibo trolls the so called Water Army can be hired to post deceptive comments. In this paper, we focus on troll detection via sentiment analysis and other user activity data on the Sina Weibo platform. We implement techniques for Chinese sentence segmentation, word embedding, and sentiment score calculation. In recent years, troll detection and sentiment analysis have been studied, but we are not aware of previous research that considers troll detection based on sentiment analysis. We employ the resulting techniques to develop and test a sentiment analysis approach for troll detection, based on a variety of machine learning strategies. Experimental results are generated and analyzed. A Chrome extension is presented that implements our proposed technique, which enables real time troll detection when a user browses Sina Weibo.


Current Challenges and Future Directions in Podcast Information Access. Podcasts are spoken documents across a wide range of genres and styles, with growing listenership across the world, and a rapidly lowering barrier to entry for both listeners and creators. The great strides in search and recommendation in research and industry have yet to see impact in the podcast space, where recommendations are still largely driven by word of mouth. In this perspective paper, we highlight the many differences between podcasts and other media, and discuss our perspective on challenges and future research directions in the domain of podcast information access.


Scalable, Decentralized Multi Agent Reinforcement Learning Methods Inspired by Stigmergy and Ant Colonies. Bolstering multi agent learning algorithms to tackle complex coordination and control tasks has been a long standing challenge of on going research. Numerous methods have been proposed to help reduce the effects of non stationarity and unscalability. In this work, we investigate a novel approach to decentralized multi agent learning and planning that attempts to address these two challenges. In particular, this method is inspired by the cohesion, coordination, and behavior of ant colonies. As a result, these algorithms are designed to be naturally scalable to systems with numerous agents. While no optimality is guaranteed, the method is intended to work well in practice and scale better in efficacy with the number of agents present than others. The approach combines single agent RL and an ant colony inspired decentralized, stigmergic algorithm for multi agent path planning and environment modification. Specifically, we apply this algorithm in a setting where agents must navigate to a goal location, learning to push rectangular boxes into holes to yield new traversable pathways. It is shown that while the approach yields promising success in this particular environment, it may not be as easily generalized to others. The algorithm designed is notably scalable to numerous agents but is limited in its performance due to its relatively simplistic, rule based approach. Furthermore, the composability of RL trained policies is called into question, where, while policies are successful in their training environments, applying trained policies to a larger scale, multi agent framework results in unpredictable behavior.


Accuracy Evaluation of Touch Tasks in Commodity Virtual and Augmented Reality Head Mounted Displays. An increasing number of consumer oriented head mounted displays (HMD) for augmented and virtual reality (AR VR) are capable of finger and hand tracking. We report on the accuracy of off the shelf VR and AR HMDs when used for touch based tasks such as pointing or drawing. Specifically, we report on the finger tracking accuracy of the VR head mounted displays Oculus Quest, Vive Pro and the Leap Motion controller, when attached to a VR HMD, as well as the finger tracking accuracy of the AR head mounted displays Microsoft HoloLens 2 and Magic Leap. We present the results of two experiments in which we compare the accuracy for absolute and relative pointing tasks using both human participants and a robot. The results suggest that HTC Vive has a lower spatial accuracy than the Oculus Quest and Leap Motion and that the Microsoft HoloLens 2 provides higher spatial accuracy than Magic Leap One. These findings can serve as decision support for researchers and practitioners in choosing which systems to use in the future.


A two sex branching process with oscillations application to predator prey systems. A two type two sex branching process is introduced with the aim of describing the interaction of predator and prey populations with sexual reproduction and promiscuous mating. In each generation and in each species the total number of individuals which mate and produce offspring is controlled by a binomial distribution with size given by this number of individuals and probability of success depending on the density of preys per predator. The resulting model enables us to depict the typical cyclic behaviour of predator prey systems under some mild assumptions on the shape of the function that characterises the probability of survival of the previous binomial distribution. We present some basic results about fixation and extinction of both species as well as conditions for the coexistence of both of them. We also analyse the suitability of the process to model real ecosystems comparing our model with a real dataset.


Generalized Collatz Maps with Almost Bounded Orbits. If dividing by p is a mistake, multiply by q and translate, and so you'll live to iterate. We show that if we define a Collatz like map in this form then, under suitable conditions on p and q , almost all orbits of this map attain almost bounded values. This generalizes a recent breakthrough result of Tao for the original Collatz map (i.e., p 2 and q 3 ). In other words, given an arbitrary growth function N mapsto f(N) we show that almost every orbit of such map with input N eventually attains a value smaller than f(N) .


Artificial intelligence prediction of stock prices using social media. The primary objective of this work is to develop a Neural Network based on LSTM to predict stock market movements using tweets. Word embeddings, used in the LSTM network, are initialised using Stanford's GloVe embeddings, pretrained specifically on 2 billion tweets. To overcome the limited size of the dataset, an augmentation strategy is proposed to split each input sequence into 150 subsets. To achieve further improvements in the original configuration, hyperparameter optimisation is performed. The effects of variation in hyperparameters such as dropout rate, batch size, and LSTM hidden state output size are assessed individually. Furthermore, an exhaustive set of parameter combinations is examined to determine the optimal model configuration. The best performance on the validation dataset is achieved by hyperparameter combination 0.4,8,100 for the dropout, batch size, and hidden units respectively. The final testing accuracy of the model is 76.14 .


Fast and Accurate Optimization of Metasurfaces with Gradient Descent and the Woodbury Matrix Identity. A fast metasurface optimization strategy for finite size metasurfaces modeled using integral equations is presented. The metasurfaces considered are constructed from finite patterned metallic claddings supported by grounded dielectric spacers. Integral equations are used to model the response of the metasurface to a known excitation and solved by Method of Moments. An accelerated gradient descent optimization algorithm is presented that enables the direct optimization of such metasurfaces. The gradient is normally calculated by solving the method of moments problem N 1 times where N is the number of homogenized elements in the metasurface. Since the calculation of each component of the N dimensional gradient involves perturbing the moment method impedance matrix along one element of its diagonal and inverting the result, this numerical gradient calculation can be accelerated using the Woodbury Matrix Identity. The Woodbury Matrix Identity allows the inverse of the perturbed impedance matrix to be computed at a low cost by forming a rank r correction to the inverse of the unperturbed impedance matrix. Timing diagrams show up to a 26.5 times improvement in algorithm times when the acceleration technique is applied. An example of a passive and lossless wide angle reflecting metasurface designed using the accelerated optimization technique is reported.


AdaAfford Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few shot Interactions. Perceiving and interacting with 3D articulated objects, such as cabinets, doors, and faucets, pose particular challenges for future home assistant robots performing daily tasks in human environments. Besides parsing the articulated parts and joint parameters, researchers recently advocate learning manipulation affordance over the input shape geometry which is more task aware and geometrically fine grained. However, taking only passive observations as inputs, these methods ignore many hidden but important kinematic constraints (e.g., joint location and limits) and dynamic factors (e.g., joint friction and restitution), therefore losing significant accuracy for test cases with such uncertainties. In this paper, we propose a novel framework, named AdaAfford, that learns to perform very few test time interactions for quickly adapting the affordance priors to more accurate instance specific posteriors. We conduct large scale experiments using the PartNet Mobility dataset and prove that our system performs better than baselines.


3D Point Cloud Completion with Geometric Aware Adversarial Augmentation. With the popularity of 3D sensors in self driving and other robotics applications, extensive research has focused on designing novel neural network architectures for accurate 3D point cloud completion. However, unlike in point cloud classification and reconstruction, the role of adversarial samples in3D point cloud completion has seldom been explored. In this work, we show that training with adversarial samples can improve the performance of neural networks on 3D point cloud completion tasks. We propose a novel approach to generate adversarial samples that benefit both the performance of clean and adversarial samples. In contrast to the PGD k attack, our method generates adversarial samples that keep the geometric features in clean samples and contain few outliers. In particular, we use principal directions to constrain the adversarial perturbations for each input point. The gradient components in the mean direction of principal directions are taken as adversarial perturbations. In addition, we also investigate the effect of using the minimum curvature direction. Besides, we adopt attack strength accumulation and auxiliary Batch Normalization layers method to speed up the training process and alleviate the distribution mismatch between clean and adversarial samples. Experimental results show that training with the adversarial samples crafted by our method effectively enhances the performance of PCN on the ShapeNet dataset.


Generalized Contrastive Optimization of Siamese Networks for Place Recognition. Visual place recognition is a challenging task in computer vision and a key component of camera based localization and navigation systems. Recently, Convolutional Neural Networks (CNNs) achieved high results and good generalization capabilities. They are usually trained using pairs or triplets of images labeled as either similar or dissimilar, in a binary fashion. In practice, the similarity between two images is not binary, but continuous. Furthermore, training these CNNs is computationally complex and involves costly pair and triplet mining strategies. We propose a Generalized Contrastive loss (GCL) function that relies on image similarity as a continuous measure, and use it to train a siamese CNN. Furthermore, we present three techniques for automatic annotation of image pairs with labels indicating their degree of similarity, and deploy them to re annotate the MSLS, TB Places, and 7Scenes datasets. We demonstrate that siamese CNNs trained using the GCL function and the improved annotations consistently outperform their binary counterparts. Our models trained on MSLS outperform the state of the art methods, including NetVLAD, NetVLAD SARE, AP GeM and Patch NetVLAD, and generalize well on the Pittsburgh30k, Tokyo 24 7, RobotCar Seasons v2 and Extended CMU Seasons datasets. Furthermore, training a siamese network using the GCL function does not require complex pair mining. We release the source code at https github.com marialeyvallina generalized contrastive loss.


Implicit and semi implicit second order time stepping methods for the Richards equation. This study concerns numerical methods for efficiently solving the Richards equation where different weak formulations and computational techniques are analyzed. The spatial discretizations are based on standard or mixed finite element methods. Different implicit and semi implicit temporal discretization techniques of second order accuracy are studied. To obtain a linear system for the semi implicit schemes, we propose second order techniques using extrapolation formulas and or semi implicit Taylor approximations for the temporal discretization of nonlinear terms. A numerical convergence study and a series of numerical tests are performed to analyze efficiency and robustness of the different schemes. The developed scheme, based on the proposed temporal extrapolation techniques and the mixed formulation involving the saturation and pressure head and using the standard linear Lagrange element, performs better than other schemes based on the saturation and the flux and using the Raviart Thomas elements. The proposed semi implicit scheme is a good alternative when implicit schemes meet convergence issues.


ASM2TV An Adaptive Semi Supervised Multi Task Multi View Learning Framework for Human Activity Recognition. Many real world scenarios, such as human activity recognition (HAR) in IoT, can be formalized as a multi task multi view learning problem. Each specific task consists of multiple shared feature views collected from multiple sources, either homogeneous or heterogeneous. Common among recent approaches is to employ a typical hard soft sharing strategy at the initial phase separately for each view across tasks to uncover common knowledge, underlying the assumption that all views are conditionally independent. On the one hand, multiple views across tasks possibly relate to each other under practical situations. On the other hand, supervised methods might be insufficient when labeled data is scarce. To tackle these challenges, we introduce a novel framework ASM2TV for semi supervised multi task multi view learning. We present a new perspective named gating control policy, a learnable task view interacted sharing policy that adaptively selects the most desirable candidate shared block for any view across any task, which uncovers more fine grained task view interacted relatedness and improves inference efficiency. Significantly, our proposed gathering consistency adaption procedure takes full advantage of large amounts of unlabeled fragmented time series, making it a general framework that accommodates a wide range of applications. Experiments on two diverse real world HAR benchmark datasets collected from various subjects and sources demonstrate our framework's superiority over other state of the arts. The detailed codes are available at https github.com zachstarkk ASM2TV.


SLD resolution without occur check, an example. We prove that the occur check is not needed for a certain definite clause logic program, independently from the selection rule. First we prove that the program is occur check free. Then we consider a more general class of queries, under which the program is not occur check free however we show that it will be correctly executed under Prolog without occur check. The main result of this report states that the occur check may be skipped for the cases in which a single run of a standard nondeterministic unification algorithm does not fail due to the occur check. The usual approaches are based on the notion of NSTO (not subject to occur check), which considers all the runs. To formulate the result, it was necessary to introduce an abstraction of a "unification" algorithm without the occur check.


Rate Splitting Multiple Access for Communications and Jamming in Multi Antenna Multi Carrier Cognitive Radio Systems. With the increasing number of wireless communication systems and the demand for bandwidth, the wireless medium has become a congested and contested environment. Operating under such an environment brings several challenges, especially for military communication systems, which need to guarantee reliable communication while avoiding interfering with other friendly or neutral systems and denying the enemy systems of service. In this work, we investigate a novel application of Rate Splitting Multiple Access(RSMA) for joint communications and jamming with a Multi Carrier(MC) waveform in a multiantenna Cognitive Radio(CR) system. RSMA is a robust multiple access scheme for downlink multi antenna wireless networks. RSMA relies on multi antenna Rate Splitting (RS) at the transmitter and Successive Interference Cancellation (SIC) at the receivers. Our aim is to simultaneously communicate with Secondary Users(SUs) and jam Adversarial Users(AUs) to disrupt their communications while limiting the interference to Primary Users(PUs) in a setting where all users perform broadband communications by MC waveforms in their respective networks. We consider the practical setting of imperfect CSI at transmitter(CSIT) for the SUs and PUs, and statistical CSIT for AUs. We formulate a problem to obtain optimal precoders which maximize the mutual information under interference and jamming power constraints. We propose an Alternating Optimization Alternating Direction Method of Multipliers(AOADMM) based algorithm for solving the resulting non convex problem. We perform an analysis based on Karush Kuhn Tucker conditions to determine the optimal jamming and interference power thresholds that guarantee the feasibility of problem and propose a practical algorithm to calculate the interference power threshold. By simulations, we show that RSMA achieves a higher sum rate than Space Division Multiple Access(SDMA).


Decentralized Spatial Temporal Trajectory Planning for Multicopter Swarms. Multicopter swarms with decentralized structure possess the nature of flexibility and robustness, while efficient spatial temporal trajectory planning still remains a challenge. This report introduces decentralized spatial temporal trajectory planning, which puts a well formed trajectory representation named MINCO into multi agent scenarios. Our method ensures high quality local planning for each agent subject to any constraint from either the coordination of the swarm or safety requirements in cluttered environments. Then, the local trajectory generation is formulated as an unconstrained optimization problem that is efficiently solved in milliseconds. Moreover, a decentralized asynchronous mechanism is designed to trigger the local planning for each agent. A systematic solution is presented with detailed descriptions of careful engineering considerations. Extensive benchmarks and indoor outdoor experiments validate its wide applicability and high quality. Our software will be released for the reference of the community.


alpha Firmly Nonexpansive Operators on Metric Spaces. We extend to p uniformly convex spaces tools from the analysis of fixed point iterations in linear spaces. This study is restricted to an appropriate generalization of single valued, pointwise alpha averaged mappings. Our main contribution is establishing a calculus for these mappings in p uniformly convex spaces, showing in particular how the property is preserved under compositions and convex combinations. This is of central importance to splitting algorithms that are built by such convex combinations and compositions, and reduces the convergence analysis to simply verifying alpha firm nonexpansiveness of the individual components at fixed points of the splitting algorithms. Our convergence analysis differs from what can be found in the previous literature in that only alpha firm nonexpansiveness with respect to fixed points is required. Indeed we show that, if the fixed point mapping is pointwise nonexpansive at all cluster points, then these cluster points are in fact fixed points, and convergence of the sequence follows. Additionally, we provide a quantitative convergence analysis built on the notion of gauge metric subregularity, which we show is necessary for quantifiable convergence estimates. This allows one for the first time to prove convergence of a tremendous variety of splitting algorithms in spaces with curvature bounded from above.


Implication in finite posets with pseudocomplemented sections. It is well known that relatively pseudocomplemented lattices can serve as an algebraic semantics of intuitionistic logic. To extend the concept of relative pseudocomplementation to non distributive lattices, the first author introduced so called sectionally pseudocomplemented lattices, i.e. lattices with top element 1 where for every element y the interval y,1 , the so called section, is pseudocomplemented. We extend this concept to posets with top element. Our goal is to show that such a poset can be considered as an algebraic semantics for a certain kind of more general intuitionistic logic provided an implication is introduced as shown in the paper. We prove some properties of such an implication. This implication is "unsharp" in the sense that the value for given entries need not be a unique element, but may be a subset of the poset in question. On the other hand, all of these values are as high as possible. We show that this implication even determines the poset and if a new operator odot is introduced in an "unsharp" way, such structure forms an "unsharply" residuated poset.


Periodic Schur sigma groups of non elementary bicyclic type. Infinitely many large Schur sigma groups G with non elementary bicyclic commutator quotient G G' C(3 e) x C(3), e 2, are constructed as periodic sequences of vertices in descendant trees of finite 3 groups. A single root gives rise to pairs of metabelian groups G with logarithmic order lo(G) 4 e for e 3. Three roots are ancestors of pairs of non metabelian groups G with moderate rank distribution rho(G) (2,2,3 3) and lo(G) 7 e for e 5. Twentyseven roots produce sextets of non metabelian groups G with elevated rank distribution rho(G) (3,3,3 3) and lo(G) 19 e for e 9. The soluble length of non metabelian groups is always sl(G) 3. The groups can be realized as 3 class field tower groups Gal(F(3,infty,K) K) of imaginary quadratic number fields K Q(d 1 2) with fundamental discriminants d 0.


Reconfiguration Problems on Submodular Functions. Reconfiguration problems require finding a step by step transformation between a pair of feasible solutions for a particular problem. The primary concern in Theoretical Computer Science has been revealing their computational complexity for classical problems. This paper presents an initial study on reconfiguration problems derived from a submodular function, which has more of a flavor of Data Mining. Our submodular reconfiguration problems request to find a solution sequence connecting two input solutions such that each solution has an objective value above a threshold in a submodular function f 2 n to mathbb R and is obtained from the previous one by applying a simple transformation rule. We formulate three reconfiguration problems Monotone Submodular Reconfiguration (MSReco), which applies to influence maximization, and two versions of Unconstrained Submodular Reconfiguration (USReco), which apply to determinantal point processes. Our contributions are summarized as follows 1. We prove that MSReco and USReco are both mathsf PSPACE complete. 2. We design a frac 1 2 approximation algorithm for MSReco and a frac 1 n approximation algorithm for (one version of) USReco. 3. We devise inapproximability results that approximating the optimum value of MSReco within a (1 frac 1 epsilon n 2 ) factor is mathsf PSPACE hard, and we cannot find a ( frac 5 6 epsilon) approximation for USReco. 4. We conduct numerical study on the reconfiguration version of influence maximization and determinantal point processes using real world social network and movie rating data.


Recombinant Sort N Dimensional Cartesian Spaced Algorithm Designed from Synergetic Combination of Hashing, Bucket, Counting and Radix Sort. Sorting is an essential operation which is widely used and is fundamental to some very basic day to day utilities like searches, databases, social networks and much more. Optimizing this basic operation in terms of complexity as well as efficiency is cardinal. Optimization is achieved with respect to space and time complexities of the algorithm. In this paper, a novel left field N dimensional cartesian spaced sorting method is proposed by combining the best characteristics of bucket sort, counting sort and radix sort, in addition to employing hashing and dynamic programming for making the method more efficient. Comparison between the proposed sorting method and various existing sorting methods like bubble sort, insertion sort, selection sort, merge sort, heap sort, counting sort, bucket sort, etc., has also been performed. The time complexity of the proposed model is estimated to be linear i.e. O(n) for the best, average and worst cases, which is better than every sorting algorithm introduced till date.


BERT Meets Relational DB Contextual Representations of Relational Databases. In this paper, we address the problem of learning low dimension representation of entities on relational databases consisting of multiple tables. Embeddings help to capture semantics encoded in the database and can be used in a variety of settings like auto completion of tables, fully neural query processing of relational joins queries, seamlessly handling missing values, and more. Current work is restricted to working with just single table, or using pretrained embeddings over an external corpus making them unsuitable for use in real world databases. In this work, we look into ways of using these attention based model to learn embeddings for entities in the relational database. We are inspired by BERT style pretraining methods and are interested in observing how they can be extended for representation learning on structured databases. We evaluate our approach of the autocompletion of relational databases and achieve improvement over standard baselines.


NetFense Adversarial Defenses against Privacy Attacks on Neural Networks for Graph Data. Recent advances in protecting node privacy on graph data and attacking graph neural networks (GNNs) gain much attention. The eye does not bring these two essential tasks together yet. Imagine an adversary can utilize the powerful GNNs to infer users' private labels in a social network. How can we adversarially defend against such privacy attacks while maintaining the utility of perturbed graphs? In this work, we propose a novel research task, adversarial defenses against GNN based privacy attacks, and present a graph perturbation based approach, NetFense, to achieve the goal. NetFense can simultaneously keep graph data unnoticeability (i.e., having limited changes on the graph structure), maintain the prediction confidence of targeted label classification (i.e., preserving data utility), and reduce the prediction confidence of private label classification (i.e., protecting the privacy of nodes). Experiments conducted on single and multiple target perturbations using three real graph data exhibit that the perturbed graphs by NetFense can effectively maintain data utility (i.e., model unnoticeability) on targeted label classification and significantly decrease the prediction confidence of private label classification (i.e., privacy protection). Extensive studies also bring several insights, such as the flexibility of NetFense, preserving local neighborhoods in data unnoticeability, and better privacy protection for high degree nodes.


Automatically detecting data drift in machine learning classifiers. Classifiers and other statistics based machine learning (ML) techniques generalize, or learn, based on various statistical properties of the training data. The assumption underlying statistical ML resulting in theoretical or empirical performance guarantees is that the distribution of the training data is representative of the production data distribution. This assumption often breaks for instance, statistical distributions of the data may change. We term changes that affect ML performance data drift' or drift'. Many classification techniques compute a measure of confidence in their results. This measure might not reflect the actual ML performance. A famous example is the Panda picture that is correctly classified as such with a confidence of about 60 , but when noise is added it is incorrectly classified as a Gibbon with a confidence of above 99 . However, the work we report on here suggests that a classifier's measure of confidence can be used for the purpose of detecting data drift. We propose an approach based solely on classifier suggested labels and its confidence in them, for alerting on data distribution or feature space changes that are likely to cause data drift. Our approach identities degradation in model performance and does not require labeling of data in production which is often lacking or delayed. Our experiments with three different data sets and classifiers demonstrate the effectiveness of this approach in detecting data drift. This is especially encouraging as the classification itself may or may not be correct and no model input data is required. We further explore the statistical approach of sequential change point tests to automatically determine the amount of data needed in order to identify drift while controlling the false positive rate (Type 1 error).


The Stefan Boltzmann constant re visited for photons thermally generated within matter. The Stefan Boltzmann constant arose from photon densities inside a cavity, but inside matter photon mode densities are material specific. Photon speeds are governed by the mode they occupy, so mode densities can be expressed in terms of speed. Cavity intensities at temperature (T K ) combined ( left frac 8 pi k 4 c 3h 3 right T K 4 ) with (( pi 4 15 ) ). A material dependent number from summation of internal photon spectral energy densities replaces ( frac pi 4 15 ). Spectral densities are presented for water, germanium and silver. Output intensity combines revised hemispherical emittance ( epsilon Q,H ) based on these densities, with universal factor ( left frac 8 pi k 4 c 3h 3 right T K 4 ). Emitted radiance after interface internal reflectance of directionally invariant internal radiance elements defines ( epsilon Q,H ). Predicted internal densities are verifiable using measured external spectral intensities, provided refraction upon exit is accounted for in emissivity, which the Kirchhoff rule neglects. Virtual bound state photon resonances are predicted in dielectrics and observed.


Changes in the b value in and around the focal areas of the M6.9 and M6.8 earthquakes off the coast of Miyagi prefecture, Japan, in 2021. We investigated changes in the b value of the Gutenberg Richter's law in and around the focal areas of earthquakes on March 20 and on May 1, 2021, with magnitude (M) 6.9 and 6.8, respectively, which occurred off the Pacific coast of Miyagi prefecture, northeastern Japan. We showed that the b value in these focal areas had been noticeably small, especially within a few years before the occurrence of the M6.9 earthquake in its vicinity, indicating that differential stress had been high in the focal areas. The coseismic slip of the 2011 Tohoku earthquake seems to have stopped just short of the east side of the focus of the M6.9 earthquake. Furthermore, the afterslip of the 2011 Tohoku earthquake was relatively small in the focal areas of the M6.9 and M6.8 earthquakes, compared to the surrounding regions. In addition, the focus of the M6.9 earthquake was situated close to the border point where the interplate slip in the period from 2012 through 2021 has been considerably larger on the northern side than on the southern side. The high stress state inferred by the b value analysis is concordant with those characteristics of interplate slip events. We found that the M6.8 earthquake on May 1 occurred near an area where the b value remained small, even after the M6.9 quake. The ruptured areas by the two earthquakes now seem to almost coincide with the small b value region that had existed before their occurrence. The b value on the east side of the focal areas of the M6.9 and M6.8 earthquakes which corresponds to the eastern part of the source region of the 1978 off Miyagi prefecture earthquake was consistently large, while the seismicity enhanced by the two earthquakes also shows a large b value, implying that stress in the region has not been very high.


Energy Efficient UAV Multicasting with Simultaneous FSO Backhaul and Power Transfer. This letter studies an unmanned aerial vehicle (UAV) aided multicasting (MC) system, which is enabled by simultaneous free space optics (FSO) backhaul and power transfer. The UAV applies the power splitting technique to harvest wireless power and decode backhaul information simultaneously over the FSO link, while at the same time using the harvested power to multicast the backhauled information over the radio frequency (RF) links to multiple ground users (GUs). We derive the UAV's achievable MC rate under the Poisson point process (PPP) based GU distribution. By jointly designing the FSO and RF links and the UAV altitude, we maximize the system level energy efficiency (EE), which can be equivalently expressed as the ratio of the UAV's MC rate over the optics base station (OBS) transmit power, subject to the UAV's sustainable operation and reliable backhauling constraints. Due to the non convexity of this problem, we propose suboptimal solutions with low complexity. Numerical results show the close to optimal EE performance by properly balancing the power rate tradeoff between the FSO power and the MC data transmissions.


Sentence Structure and Word Relationship Modeling for Emphasis Selection. Emphasis Selection is a newly proposed task which focuses on choosing words for emphasis in short sentences. Traditional methods only consider the sequence information of a sentence while ignoring the rich sentence structure and word relationship information. In this paper, we propose a new framework that considers sentence structure via a sentence structure graph and word relationship via a word similarity graph. The sentence structure graph is derived from the parse tree of a sentence. The word similarity graph allows nodes to share information with their neighbors since we argue that in emphasis selection, similar words are more likely to be emphasized together. Graph neural networks are employed to learn the representation of each node of these two graphs. Experimental results demonstrate that our framework can achieve superior performance.


3D Image Super Resolution by fluorophore fluctuations and MA TIRF Microscopy reconstruction (3D COL0RME). We propose a 3D super resolution approach to improve both lateral and axial spatial resolution in Total Internal Reflectance Fluorescence (TIRF) imaging applications. Our approach, called 3D COL0RME (3D Covariance based ell 0 super Resolution Microscopy with intensity Estimation) improves both lateral and axial resolution by combining sparsity based modelling for precise molecule localisation and intensity estimation in the lateral plane with a 3D reconstruction procedure in the axial one using Multi Angle TIRF (MA TIRF). Differently from state of the art approaches, 3D COL0RME does not require the use of special equipment as it can be used with standard fluorophores. We validate 3D COL0RME on simulated MA TIRF blinking type data and on challenging real MA TIRF acquisitions, showing significant resolution improvements.


Stable cuspidal curves and the integral Chow ring of overline mathscr M 2,1 . In this paper we introduce the moduli stack widetilde mathscr M g,n of n marked stable at most cuspidal curves of genus g and we use it to determine the integral Chow ring of overline mathscr M 2,1 . Along the way, we also determine the integral Chow ring of overline mathscr M 1,2 .


On the regularity of the complex Hessian equation. This note aims to investigate the regularity of a solution to the Dirichlet problem for the complex Hessian equation, which has a density of the m Hessian measure that belongs to L q , for q leq frac nm .


Accelerated Almost Sure Convergence Rates for Nonconvex Stochastic Gradient Descent using Stochastic Learning Rates. Large scale optimization problems require algorithms both effective and efficient. One such popular and proven algorithm is Stochastic Gradient Descent which uses first order gradient information to solve these problems. This paper studies almost sure convergence rates of the Stochastic Gradient Descent method when instead of deterministic, its learning rate becomes stochastic. In particular, its learning rate is equipped with a multiplicative stochasticity, producing a stochastic learning rate scheme. Theoretical results show accelerated almost sure convergence rates of Stochastic Gradient Descent in a nonconvex setting when using an appropriate stochastic learning rate, compared to a deterministic learning rate scheme. The theoretical results are verified empirically.


Note on spherical quandles. This paper aims to give a one to one correspondence between SU(2) representations of knot groups and colorings of knots with spherical quandles and give a geometric meaning of the "trace free" condition we need to define Casson Lin invariant.


Comment on "Stokes' first problem for heated flat plate with Atangana Baleanu fractional derivative" Chaos Solitons Fractals 117 (2018) 68 . In the sense of distributions, the derivative of the Heaviside unit step function H(t) is a generalized Dirac delta distribution. If the velocity V(t) of a flat plate is impulsive, as V(t) H(t) (i.e., it is suddenly set into motion with unit velocity at t 0 ), then its acceleration is V'(t) delta(t) . The Dirac delta distribution has no point values. However, when the Dirac delta is the forcing term of an ODE (in t ), it contributes to the solution. The recently published paper Chaos Solitons Fractals 117 (2018) 68 incorrectly treats the Dirac delta function as being identically 0. This Comment analyzes the source of this error, and provides guidance on how to correct it (based on the established literature). The mathematical error identified is in addition to some issues about rheological models with fractional derivatives, which are also noted. That is to say, whether or not an "Atangana Baleanu fractional derivative" is used in Chaos Solitons Fractals 117 (2018) 68 , the solution to Stokes' first problem provided therein is not correct.


MonoCInIS Camera Independent Monocular 3D Object Detection using Instance Segmentation. Monocular 3D object detection has recently shown promising results, however there remain challenging problems. One of those is the lack of invariance to different camera intrinsic parameters, which can be observed across different 3D object datasets. Little effort has been made to exploit the combination of heterogeneous 3D object datasets. In contrast to general intuition, we show that more data does not automatically guarantee a better performance, but rather, methods need to have a degree of 'camera independence' in order to benefit from large and heterogeneous training data. In this paper we propose a category level pose estimation method based on instance segmentation, using camera independent geometric reasoning to cope with the varying camera viewpoints and intrinsics of different datasets. Every pixel of an instance predicts the object dimensions, the 3D object reference points projected in 2D image space and, optionally, the local viewing angle. Camera intrinsics are only used outside of the learned network to lift the predicted 2D reference points to 3D. We surpass camera independent methods on the challenging KITTI3D benchmark and show the key benefits compared to camera dependent methods.


Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation. This paper addresses the problem of simultaneous machine translation (SiMT) by exploring two main concepts (a) adaptive policies to learn a good trade off between high translation quality and low latency and (b) visual information to support this process by providing additional (visual) contextual information which may be available before the textual input is produced. For that, we propose a multimodal approach to simultaneous machine translation using reinforcement learning, with strategies to integrate visual and textual information in both the agent and the environment. We provide an exploration on how different types of visual information and integration strategies affect the quality and latency of simultaneous translation models, and demonstrate that visual cues lead to higher quality while keeping the latency low.


Approximation, Gelfand, and Kolmogorov numbers of Schatten class embeddings. Let 0 p,q leq infty and denote by mathcal S p N and mathcal S q N the corresponding Schatten classes of real N times N matrices. We study approximation quantities of natural identities mathcal S p N hookrightarrow mathcal S q N between Schatten classes and prove asymptotically sharp bounds up to constants only depending on p and q , showing how approximation numbers are intimately related to the Gelfand numbers and their duals, the Kolmogorov numbers. In particular, we obtain new bounds for those sequences of s numbers. Our results improve and complement bounds previously obtained by B. Carl and A. Defant J. Approx. Theory, 88(2) 228 256, 1997 , Y. Gordon, H. K "onig, and C. Sch "utt J. Approx. Theory, 49(3) 219 239, 1987 , A. Hinrichs and C. Michels Rend. Circ. Mat. Palermo (2) Suppl., (76) 395 411, 2005 , and A. Hinrichs, J. Prochno, and J. Vyb 'iral preprint, 2020 . We also treat the case of quasi Schatten norms, which is relevant in applications such as low rank matrix recovery.


Generative Adversarial Network (GAN) and Enhanced Root Mean Square Error (ERMSE) Deep Learning for Stock Price Movement Prediction. The prediction of stock price movement direction is significant in financial circles and academic. Stock price contains complex, incomplete, and fuzzy information which makes it an extremely difficult task to predict its development trend. Predicting and analysing financial data is a nonlinear, time dependent problem. With rapid development in machine learning and deep learning, this task can be performed more effectively by a purposely designed network. This paper aims to improve prediction accuracy and minimizing forecasting error loss through deep learning architecture by using Generative Adversarial Networks. It was proposed a generic model consisting of Phase space Reconstruction (PSR) method for reconstructing price series and Generative Adversarial Network (GAN) which is a combination of two neural networks which are Long Short Term Memory (LSTM) as Generative model and Convolutional Neural Network (CNN) as Discriminative model for adversarial training to forecast the stock market. LSTM will generate new instances based on historical basic indicators information and then CNN will estimate whether the data is predicted by LSTM or is real. It was found that the Generative Adversarial Network (GAN) has performed well on the enhanced root mean square error to LSTM, as it was 4.35 more accurate in predicting the direction and reduced processing time and RMSE by 78 secs and 0.029, respectively. This study provides a better result in the accuracy of the stock index. It seems that the proposed system concentrates on minimizing the root mean square error and processing time and improving the direction prediction accuracy, and provides a better result in the accuracy of the stock index.


Information Theoretic Measures for Fairness aware Feature Selection. Machine learning algorithms are increasingly used for consequential decision making regarding individuals based on their relevant features. Features that are relevant for accurate decisions may however lead to either explicit or implicit forms of discrimination against unprivileged groups, such as those of certain race or gender. This happens due to existing biases in the training data, which are often replicated or even exacerbated by the learning algorithm. Identifying and measuring these biases at the data level is a challenging problem due to the interdependence among the features, and the decision outcome. In this work, we develop a framework for fairness aware feature selection which takes into account the correlation among the features and the decision outcome, and is based on information theoretic measures for the accuracy and discriminatory impacts of features. In particular, we first propose information theoretic measures which quantify the impact of different subsets of features on the accuracy and discrimination of the decision outcomes. We then deduce the marginal impact of each feature using Shapley value function a solution concept in cooperative game theory used to estimate marginal contributions of players in a coalitional game. Finally, we design a fairness utility score for each feature (for feature selection) which quantifies how this feature influences accurate as well as nondiscriminatory decisions. Our framework depends on the joint statistics of the data rather than a particular classifier design. We examine our proposed framework on real and synthetic data to evaluate its performance.


Neural network acceleration of projection based model order reduction for finite plasticity Application to RVEs. Compared to conventional projection based model order reduction, its neural network acceleration has the advantage that the online simulations are equation free, meaning that no system of equations needs to be solved iteratively. Consequently, no stiffness matrix needs to be constructed and the stress update needs to be computed only once per increment. In this contribution, a recurrent neural network is developed to accelerate a projection based model order reduction of the elastoplastic mechanical behaviour of an RVE. In contrast to a neural network that merely emulates the relation between the macroscopic deformation (path) and the macroscopic stress, the neural network acceleration of projection based model order reduction preserves all microstructural information, at the price of computing this information once per increment.


Transitioning from Real to Synthetic data Quantifying the bias in model. With the advent of generative modeling techniques, synthetic data and its use has penetrated across various domains from unstructured data such as image, text to structured dataset modeling healthcare outcome, risk decisioning in financial domain, and many more. It overcomes various challenges such as limited training data, class imbalance, restricted access to dataset owing to privacy issues. To ensure the trained model used for automated decisioning purposes makes a fair decision there exist prior work to quantify and mitigate those issues. This study aims to establish a trade off between bias and fairness in the models trained using synthetic data. Variants of synthetic data generation techniques were studied to understand bias amplification including differentially private generation schemes. Through experiments on a tabular dataset, we demonstrate there exist a varying levels of bias impact on models trained using synthetic data. Techniques generating less correlated feature performs well as evident through fairness metrics with 94 , 82 , and 88 relative drop in DPD (demographic parity difference), EoD (equality of odds) and EoP (equality of opportunity) respectively, and 24 relative improvement in DRP (demographic parity ratio) with respect to the real dataset. We believe the outcome of our research study will help data science practitioners understand the bias in the use of synthetic data.


An extension of the Ising Curie Weiss model of self organized criticality with long range interactions. In CG16 , Cerf and Gorny constructed a model of self organized criticality, by introducing an automatic control of the temperature parameter in the generalized Ising Curie Weiss model. In this article, we build upon this model by replacing the mean field interaction of CG16 with a one dimensional interaction with a certain range d(n) which varies as a function of the number n of particles. In the Gaussian case, we show that, for a very long range of interaction (d(n) of order n), the model exhibits the same behaviour as in the mean field case, whereas in the case of a nearest neighbour interaction (d(n) 1), the behaviour highlighted by Cerf and Gorny breaks out.


Localisation of cubical model categories. In this article we introduce the notion of a square structure on a model category, that generalises cubical model categories. We then show that under some homotopical conditions on this square structure the induced cubical category is a localisation of the model category.


Vision Guided Forecasting Visual Context for Multi Horizon Time Series Forecasting. Autonomous driving gained huge traction in recent years, due to its potential to change the way we commute. Much effort has been put into trying to estimate the state of a vehicle. Meanwhile, learning to forecast the state of a vehicle ahead introduces new capabilities, such as predicting dangerous situations. Moreover, forecasting brings new supervision opportunities by learning to predict richer a context, expressed by multiple horizons. Intuitively, a video stream originated from a front facing camera is necessary because it encodes information about the upcoming road. Besides, historical traces of the vehicle's states give more context. In this paper, we tackle multi horizon forecasting of vehicle states by fusing the two modalities. We design and experiment with 3 end to end architectures that exploit 3D convolutions for visual features extraction and 1D convolutions for features extraction from speed and steering angle traces. To demonstrate the effectiveness of our method, we perform extensive experiments on two publicly available real world datasets, Comma2k19 and the Udacity challenge. We show that we are able to forecast a vehicle's state to various horizons, while outperforming the current state of the art results on the related task of driving state estimation. We examine the contribution of vision features, and find that a model fed with vision features achieves an error that is 56.6 and 66.9 of the error of a model that doesn't use those features, on the Udacity and Comma2k19 datasets respectively.


Optimized Graph Based Routing Algorithm for the Angara Interconnect. JSC NICEVT has developed the Angara high speed interconnect with 4D torus topology. The Angara interconnect router implements deterministic routing based on the bubble flow control, a direction order routing (DOR) and direction bits rules. The router chip also supports non standard First Step Last Step for bypassing failed nodes and links, these steps can violate the DOR rule. In the previous work we have proposed an algorithm for generation and analysis of routing tables that guarantees no deadlocks in the Angara interconnect. It is based on a breadth first search algorithm in a graph and it practically does not take into consideration communication channel load. Also we have never evaluated the influence of routing table generation algorithm on the performance of a real world Angara based cluster. In this paper we present a routing graph notation that provides a possibility to build routes in the torus topology of the Angara interconnect. We propose a deadlock free routing algorithm based on a fast single source shortest path algorithm for the deterministic Angara routing with a single virtual channel. We evaluated the considered routing algorithms on a 32 node Desmos cluster system and benchmarked the proposed algorithm performance improvement of 11.1 for the Alltoall communication pattern and of more than 5 for the FT and IS application kernels.


Automatic Tuning of Tensorflow's CPU Backend using Gradient Free Optimization Algorithms. Modern deep learning (DL) applications are built using DL libraries and frameworks such as TensorFlow and PyTorch. These frameworks have complex parameters and tuning them to obtain good training and inference performance is challenging for typical users, such as DL developers and data scientists. Manual tuning requires deep knowledge of the user controllable parameters of DL frameworks as well as the underlying hardware. It is a slow and tedious process, and it typically delivers sub optimal solutions. In this paper, we treat the problem of tuning parameters of DL frameworks to improve training and inference performance as a black box optimization problem. We then investigate applicability and effectiveness of Bayesian optimization (BO), genetic algorithm (GA), and Nelder Mead simplex (NMS) to tune the parameters of TensorFlow's CPU backend. While prior work has already investigated the use of Nelder Mead simplex for a similar problem, it does not provide insights into the applicability of other more popular algorithms. Towards that end, we provide a systematic comparative analysis of all three algorithms in tuning TensorFlow's CPU backend on a variety of DL models. Our findings reveal that Bayesian optimization performs the best on the majority of models. There are, however, cases where it does not deliver the best results.


Developing for personalised learning the long road from educational objectives to development and feedback. This paper describes the development needed to support the functional and teaching requirements of iRead, a 4 year EU funded project which produced an award winning serious game utilising lexical and syntactical game content. The main functional requirement was that the game should retain different profiles for each student, encapsulating both the respective language model (which language features should be taught used in the game first, before moving on to more advanced ones) and the user model (mastery level for each feature, as reported by the student's performance in the game). In addition to this, researchers and stakeholders stated additional requirements related to learning objectives and strategies to make the game more interesting and successful these were implemented as a set of selection rules which take into account not only the mastery level for each feature, but also respect the priorities set by teachers, helping avoid repetition of content and features, and maintaining a balance between new content and revision of already mastered features to give students the sense of progress, while also reinforcing learning.


SeMask Semantically Masked Transformers for Semantic Segmentation. Finetuning a pretrained backbone in the encoder part of an image transformer network has been the traditional approach for the semantic segmentation task. However, such an approach leaves out the semantic context that an image provides during the encoding stage. This paper argues that incorporating semantic information of the image into pretrained hierarchical transformer based backbones while finetuning improves the performance considerably. To achieve this, we propose SeMask, a simple and effective framework that incorporates semantic information into the encoder with the help of a semantic attention operation. In addition, we use a lightweight semantic decoder during training to provide supervision to the intermediate semantic prior maps at every stage. Our experiments demonstrate that incorporating semantic priors enhances the performance of the established hierarchical encoders with a slight increase in the number of FLOPs. We provide empirical proof by integrating SeMask into Swin Transformer and Mix Transformer backbones as our encoder paired with different decoders. Our framework achieves a new state of the art of 58.25 mIoU on the ADE20K dataset and improvements of over 3 in the mIoU metric on the Cityscapes dataset. The code and checkpoints are publicly available at https github.com Picsart AI Research SeMask Segmentation .


Self Supervised Transformer for Sparse and Irregularly Sampled Multivariate Clinical Time Series. Multivariate time series data are frequently observed in critical care settings and are typically characterized by sparsity (missing information) and irregular time intervals. Existing approaches for learning representations in this domain handle these challenges by either aggregation or imputation of values, which in turn suppresses the fine grained information and adds undesirable noise overhead into the machine learning model. To tackle this problem, we propose a Self supervised Transformer for Time Series (STraTS) model which overcomes these pitfalls by treating time series as a set of observation triplets instead of using the standard dense matrix representation. It employs a novel Continuous Value Embedding technique to encode continuous time and variable values without the need for discretization. It is composed of a Transformer component with multi head attention layers which enable it to learn contextual triplet embeddings while avoiding the problems of recurrence and vanishing gradients that occur in recurrent architectures. In addition, to tackle the problem of limited availability of labeled data (which is typically observed in many healthcare applications), STraTS utilizes self supervision by leveraging unlabeled data to learn better representations by using time series forecasting as an auxiliary proxy task. Experiments on real world multivariate clinical time series benchmark datasets demonstrate that STraTS has better prediction performance than state of the art methods for mortality prediction, especially when labeled data is limited. Finally, we also present an interpretable version of STraTS which can identify important measurements in the time series data. Our data preprocessing and model implementation codes are available at https github.com sindhura97 STraTS.


A Numerical Scheme for Wave Turbulence 3 Wave Kinetic Equations. We introduce a finite volume scheme to solve isotropic 3 wave kinetic equations. We test our numerical solution against theoretical results concerning the long time behavior of the energy and observe that our solutions verify the energy cascade phenomenon. To our knowledge, this is the first numerical scheme that can capture the long time asymptotic behavior of solutions to isotropic 3 wave kinetic equations, where the energy cascade can be observed. Our numerical energy cascade rates are in good agreement with previously obtained theoretical results. The finite volume scheme given here relies on a new identity, allowing one to reduce the number of terms needed in the collision operators.


Difference of convex algorithms for bilevel programs with applications in hyperparameter selection. In this paper, we present difference of convex algorithms for solving bilevel programs in which the upper level objective functions are difference of convex functions, and the lower level programs are fully convex. This nontrivial class of bilevel programs provides a powerful modelling framework for dealing with applications arising from hyperparameter selection in machine learning. Thanks to the full convexity of the lower level program, the value function of the lower level program turns out to be convex and hence the bilevel program can be reformulated as a difference of convex bilevel program. We propose two algorithms for solving the reformulated difference of convex program and show their convergence under very mild assumptions. Finally we conduct numerical experiments to a bilevel model of support vector machine classification.


Merit and Blame Assignment with Kind 2. We introduce two new major features of the open source model checker Kind 2 which provide traceability information between specification and design elements such as assumptions, guarantees, or other behavioral constraints in synchronous reactive system models. This new version of Kind 2 can identify minimal sets of design elements, known as Minimal Inductive Validity Cores, which are sufficient to prove a given set of safety properties, and also determine the set of MUST elements, design elements that are necessary to prove the given properties. In addition, Kind 2 is able to find minimal sets of design constraints, known as Minimal Cut Sets, whose violation leads the system to an unsafe state. The computed information can be used for several purposes, including assessing the quality of a system specification, tracking the safety impact of model changes, and analyzing the tolerance and resilience of a system against faults or cyber attacks. We describe these new capabilities in some detail and report on an initial experimental evaluation of some of them.


Measure Twice, Cut Once Quantifying Bias and Fairness in Deep Neural Networks. Algorithmic bias is of increasing concern, both to the research community, and society at large. Bias in AI is more abstract and unintuitive than traditional forms of discrimination and can be more difficult to detect and mitigate. A clear gap exists in the current literature on evaluating the relative bias in the performance of multi class classifiers. In this work, we propose two simple yet effective metrics, Combined Error Variance (CEV) and Symmetric Distance Error (SDE), to quantitatively evaluate the class wise bias of two models in comparison to one another. By evaluating the performance of these new metrics and by demonstrating their practical application, we show that they can be used to measure fairness as well as bias. These demonstrations show that our metrics can address specific needs for measuring bias in multi class classification.


A note on the squeezing function. The squeezing problem on mathbb C can be stated as follows. Suppose that Omega is a multiply connected domain in the unit disk mathbb D containing the origin z 0 . How far can the boundary of Omega be pushed from the origin by an injective holomorphic function f Omega to mathbb D keeping the origin fixed? In this note, we discuss recent results on this problem obtained by Ng, Tang and Tsai (Math. Anal. 2020) and by Gumenyuk and Roth (arXiv 2011.13734, 2020) and also prove few new results using a method suggested in one of our previous papers (Zapiski Nauchn. Sem. POMI 1993).


A Schr "odinger model, Fock model and intertwining Segal Bargmann transform for the exceptional Lie superalgebra D(2,1 alpha) . We construct two infinite dimensional irreducible representations for D(2,1 alpha) a Schr "odinger model and a Fock model. Further, we also introduce an intertwining isomorphism. These representations are similar to the minimal representations constructed for the orthosymplectic Lie supergroup and for Hermitian Lie groups of tube type. The intertwining isomorphism is the analogue of the Segal Bargmann transform for the orthosymplectic Lie supergroup and for Hermitian Lie groups of tube type.


Cross modal Variational Auto encoder for Content based Micro video Background Music Recommendation. In this paper, we propose a cross modal variational auto encoder (CMVAE) for content based micro video background music recommendation. CMVAE is a hierarchical Bayesian generative model that matches relevant background music to a micro video by projecting these two multimodal inputs into a shared low dimensional latent space, where the alignment of two corresponding embeddings of a matched video music pair is achieved by cross generation. Moreover, the multimodal information is fused by the product of experts (PoE) principle, where the semantic information in visual and textual modalities of the micro video are weighted according to their variance estimations such that the modality with a lower noise level is given more weights. Therefore, the micro video latent variables contain less irrelevant information that results in a more robust model generalization. Furthermore, we establish a large scale content based micro video background music recommendation dataset, TT 150k, composed of approximately 3,000 different background music clips associated to 150,000 micro videos from different users. Extensive experiments on the established TT 150k dataset demonstrate the effectiveness of the proposed method. A qualitative assessment of CMVAE by visualizing some recommendation results is also included.


Regular semigroups weakly generated by idempotents. A regular semigroup is weakly generated by a set X if it has no proper regular subsemigroups containing X. In this paper, we study the regular semigroups weakly generated by idempotents. We show there exists a regular semigroup FI(X) weakly generated by X idempotents such that all other regular semigroups weakly generated by X idempotents are homomorphic images of FI(X). The semigroup FI(X) is defined by a presentation langle G(X), rho e cup rho s rangle and its structure is studied. Although each of the sets G(X) , rho e , and rho s is infinite for X geq 2 , we show that the word problem is decidable as each congruence class has a canonical form. If FI n denotes FI(X) for X n , we prove also that FI 2 contains copies of all FI n as subsemigroups. As a consequence, we conclude that (i) all regular semigroups weakly generated by a finite set of idempotents, which include all finitely idempotent generated regular semigroups, strongly divide FI 2 and (ii) all finite semigroups divide FI 2 .


FedV Privacy Preserving Federated Learning over Vertically Partitioned Data. Federated learning (FL) has been proposed to allow collaborative training of machine learning (ML) models among multiple parties where each party can keep its data private. In this paradigm, only model updates, such as model weights or gradients, are shared. Many existing approaches have focused on horizontal FL, where each party has the entire feature set and labels in the training data set. However, many real scenarios follow a vertically partitioned FL setup, where a complete feature set is formed only when all the datasets from the parties are combined, and the labels are only available to a single party. Privacy preserving vertical FL is challenging because complete sets of labels and features are not owned by one entity. Existing approaches for vertical FL require multiple peer to peer communications among parties, leading to lengthy training times, and are restricted to (approximated) linear models and just two parties. To close this gap, we propose FedV, a framework for secure gradient computation in vertical settings for several widely used ML models such as linear models, logistic regression, and support vector machines. FedV removes the need for peer to peer communication among parties by using functional encryption schemes this allows FedV to achieve faster training times. It also works for larger and changing sets of parties. We empirically demonstrate the applicability for multiple types of ML models and show a reduction of 10 70 of training time and 80 to 90 in data transfer with respect to the state of the art approaches.


Reproducible and Adaptable Log Data Generation for Sound Cybersecurity Experiments. Artifacts such as log data and network traffic are fundamental for cybersecurity research, e.g., in the area of intrusion detection. Yet, most research is based on artifacts that are not available to others or cannot be adapted to own purposes, thus making it difficult to reproduce and build on existing work. In this paper, we identify the challenges of artifact generation with the goal of conducting sound experiments that are valid, controlled, and reproducible. We argue that testbeds for artifact generation have to be designed specifically with reproducibility and adaptability in mind. To achieve this goal, we present SOCBED, our proof of concept implementation and the first testbed with a focus on generating realistic log data for cybersecurity experiments in a reproducible and adaptable manner. SOCBED enables researchers to reproduce testbed instances on commodity computers, adapt them according to own requirements, and verify their correct functionality. We evaluate SOCBED with an exemplary, practical experiment on detecting a multi step intrusion of an enterprise network and show that the resulting experiment is indeed valid, controlled, and reproducible. Both SOCBED and the log dataset underlying our evaluation are freely available.


Designing Quality Requirements, Metrics and Indicators for Core Ontologies Results of a Comparative Study for Process Core Ontologies. This preprint specifies quality requirements for a core ontology whose ontological elements such as terms, non taxonomic relationships, among others, are based on a foundational ontology. The quality requirements are represented in a quality model that is structured in the form of a requirements tree composed of characteristics and attributes to be measured and evaluated. An attribute represents an atomic aspect of an entity, that is, an elementary non functional requirement that can be measured by a direct or indirect metric and evaluated by an elementary indicator. In contrast, characteristics that model less atomic aspects of an entity cannot be measured by metrics, but rather are evaluated by derived indicators generally modeled by an aggregation function. Therefore, this preprint shows the design of direct and indirect metrics in addition to the design of elementary indicators, which are used to implement measurement and evaluation activities to obtain the results of a quality requirements tree. In particular, this document shows the applicability of the designed metrics and indicators that are used by a evaluation and comparison strategy. Two process core ontologies were preselected, evaluated and compared in order to adopt strengths in the target entity named ProcessCO. The data and information resulting from this study are also recorded, as well as the outcomes of the revaluation after improvement of the target entity.


Panoptic PolarNet Proposal free LiDAR Point Cloud Panoptic Segmentation. Panoptic segmentation presents a new challenge in exploiting the merits of both detection and segmentation, with the aim of unifying instance segmentation and semantic segmentation in a single framework. However, an efficient solution for panoptic segmentation in the emerging domain of LiDAR point cloud is still an open research problem and is very much under explored. In this paper, we present a fast and robust LiDAR point cloud panoptic segmentation framework, referred to as Panoptic PolarNet. We learn both semantic segmentation and class agnostic instance clustering in a single inference network using a polar Bird's Eye View (BEV) representation, enabling us to circumvent the issue of occlusion among instances in urban street scenes. To improve our network's learnability, we also propose an adapted instance augmentation technique and a novel adversarial point cloud pruning method. Our experiments show that Panoptic PolarNet outperforms the baseline methods on SemanticKITTI and nuScenes datasets with an almost real time inference speed. Panoptic PolarNet achieved 54.1 PQ in the public SemanticKITTI panoptic segmentation leaderboard and leading performance for the validation set of nuScenes.


Training Verifiers to Solve Math Word Problems. State of the art language models can match human performance on many tasks, but they still struggle to robustly perform multi step mathematical reasoning. To diagnose the failures of current models and support research, we introduce GSM8K, a dataset of 8.5K high quality linguistically diverse grade school math word problems. We find that even the largest transformer models fail to achieve high test performance, despite the conceptual simplicity of this problem distribution. To increase performance, we propose training verifiers to judge the correctness of model completions. At test time, we generate many candidate solutions and select the one ranked highest by the verifier. We demonstrate that verification significantly improves performance on GSM8K, and we provide strong empirical evidence that verification scales more effectively with increased data than a finetuning baseline.


Wiggling Instabilities of Temporal Localized States in Passively Mode Locked Vertical External Cavity Surface Emitting Lasers. We analyze the emergence of wiggling temporal localized states in a passively mode locked Vertical External Cavity Surface Emitting Laser composed by a gain chip and a resonant saturable absorber mirror. We show that the wiggling instability stems from the interplay between the third order dispersion induced by the micro cavities and their frequency mismatch. The latter is identified as an experimentally crucial parameter defining the range of existence of stable emission. We reveal the homoclinic scenario underlying the wiggling phenomenon and we show how it allows to control the oscillation.


Solving PDEs on Unknown Manifolds with Machine Learning. This paper proposes a mesh free computational framework and machine learning theory for solving elliptic PDEs on unknown manifolds, identified with point clouds, based on diffusion maps (DM) and deep learning. The PDE solver is formulated as a supervised learning task to solve a least squares regression problem that imposes an algebraic equation approximating a PDE (and boundary conditions if applicable). This algebraic equation involves a graph Laplacian type matrix obtained via DM asymptotic expansion, which is a consistent estimator of second order elliptic differential operators. The resulting numerical method is to solve a highly non convex empirical risk minimization problem subjected to a solution from a hypothesis space of neural network type functions. In a well posed elliptic PDE setting, when the hypothesis space consists of feedforward neural networks with either infinite width or depth, we show that the global minimizer of the empirical loss function is a consistent solution in the limit of large training data. When the hypothesis space is a two layer neural network, we show that for a sufficiently large width, the gradient descent method can identify a global minimizer of the empirical loss function. Supporting numerical examples demonstrate the convergence of the solutions and the effectiveness of the proposed solver in avoiding numerical issues that hampers the traditional approach when a large data set becomes available, e.g., large matrix inversion.


Staggered mesh method for correlation energy calculations of solids Second order M o ller Plesset perturbation theory. The calculation of the MP2 correlation energy for extended systems can be viewed as a multi dimensional integral in the thermodynamic limit, and the standard method for evaluating the MP2 energy can be viewed as a trapezoidal quadrature scheme. We demonstrate that existing analysis neglects certain contributions due to the non smoothness of the integrand, and may significantly underestimate finite size errors. We propose a new staggered mesh method, which uses two staggered Monkhorst Pack meshes for occupied and virtual orbitals, respectively, to compute the MP2 energy. The staggered mesh method circumvents a significant error source in the standard method, in which certain quadrature nodes are always placed on points where the integrand is discontinuous. One significant advantage of the proposed method is that there are no tunable parameters, and the additional numerical effort needed can be negligible compared to the standard MP2 calculation. Numerical results indicate that the staggered mesh method can be particularly advantageous for quasi 1D systems, as well as quasi 2D and 3D systems with certain symmetries.